Data Infrastructure Engineer(大數據架構工程師)

工作內容

- Design and grow the Shopee data platform to support a variety of big data applications using open-source technologies including Kafka, Hadoop, Presto, HBase, Spark, Hive, Druid, and our own creations. Some examples include a real-time data streaming platform, a unified query platform, a cluster management system, and a machine learning platform

- Dig into the source code of some open-source big data system to get the whole control and familiar with the details, configurations, designs and source code. Develop and maintain the internal release of big data systems and components as the business requirements.

- Keep close and overall monitoring for all the deployments of the systems, maintain the system’s stability, improve the performance, discover the performance bottlenecks, tracking and troubleshooting, cost optimization.

條件要求

- B. Sci. / Ms / PhD in Computer Science or a related technical field
- 2+ years of working experience in software development in at least one of these languages: Java, Scala, Python, C/C++, under Linux / Unix. Scala is a plus
- Familiar with the Big Data Infrastructure system technology like Distributed File System, Distributed Computing, Distributed Database
- Familiar with at least one of these system: Hadoop, Spark, Kafka, Presto, and other big data system
- Contributor/Committer/PMC member of some open-source big data system will be a plus
- Love to use and develop open-source technologies
- Excited to work intimately with data
- Passionate, self-motivated, and takes ownership

公司福利

• Annual Leave (18 days) + medical leave (14 days)
• Medical benefits & Insurance
• Training subsidies for online courses and external training; Language courses.
• Staff meals (Monday to Friday, free dinner and breakfast)
• Massage services by professional in-house masseurs
• In-house wellness classes (Muay Thai, beer yoga during working hours)
• Creative workshops (cookie-painting, calligraphy, etc.)
• Well-stocked pantry
• Interest groups (set up your own and financially supported by the company)
• Quarterly Team building events
• Annual company day out
• Mentorship programme
• Annual Health Screening

薪資範圍

NT$ 115,000 - 184,000 (monthly salary)

此公司其他職缺

Job Description : - Proficient in testing techniques / theo...
正職NT$ 600,000 - 1,000,000 (Annual salary)
Job Description: - Available to simulate user needs and act...
正職NT$ 600,000 - 1,000,000 (Annual salary)
Job Description: 1.能夠從用戶角度出發,模擬用戶需求及實際使用場景。 2.根據產品功能及需求,撰寫...
正職NT$ 500,000 - 700,000 (Annual salary)
- Design and implement web backend services using Python + Dja...
正職NT$ 115,000 - 184,000 (monthly salary)
- Design and implement leading platform used and loved by hund...
正職NT$ 115,000 - 184,000 (monthly salary)
- Design and development of the PaaS platform used by numerous...
正職NT$ 115,000 - 184,000 (monthly salary)
- Server side design and development of the services / systems...
正職NT$ 115,000 - 184,000 (monthly salary)
- Develop new business features and building reusable componen...
正職NT$ 115,000 - 184,000 (monthly salary)
- Responsible for MySQL and other relational database administ...
正職NT$ 115,000 - 184,000 (monthly salary)
- Setup, manage and maintain Shopee product applications and s...
正職NT$ 115,000 - 184,000 (monthly salary)
The Engineering and Technology team is at the core of the Shop...
正職NT$ 88,000 - 176,000 (monthly salary)
The Product Management team at Shopee is the key focal point b...
正職NT$ 88,000 - 176,000 (monthly salary)
- Build a big data development platform for data calculation, ...
正職NT$ 115,000 - 184,000 (monthly salary)
- Build a big data development platform for data calculation, ...
正職NT$ 115,000 - 184,000 (monthly salary)