Software Engineer- Pipeline Engineer

  • Free
  • Published date: April 8, 2024
    • California, United States

Our team is seeking a senior software engineer who will be a core team member for our advertising data platform engineering group. This engineering group focuses on big data infrastructure, operational data, audience solution, inventory forecasting and full funnel measurements as a foundation layer for ClientÂ’s addressable Ad Platforms.

Basic Qualifications:
4+ years of professional programming in Java, Scala, Python, and etc.
3+ years of big data development experience with technical stacks like Spark, Flink, Singlestore, Kafka, Nifi and AWS big data technologies
Knowledge of system, application design and architecture
Experience of build industry level high available and scalable service
Passion about technologies, and openness to interdisciplinary work
Preferred Qualifications:
Experience with processing large amounts of data at petabyte level
Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, IAM, ALB, and etc.
Experience with ClickHouse, Druid, Snowflake, Impala, Presto, Kinesis, etc.
Experience in widely used Web framework (React.js, Vue.js, Angular, etc.) and good knowledge of Web stack HTML, CSS, Webpack
Responsibilities:
Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs
Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
Chip in ground-breaking innovation and apply the state-of-the-art technologies
As a key member of the team, contribute to all aspects of the software lifecycle: design, experimentation, implementation and testing.
Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment
Required Education:
BS STEM- MUST

Preferred Education:
Bachelor or above in computer science or EE

Must have skills:
Spark, Scala, Spring/Spring Boot/Java
3-5 years general experience in addition to having experience in production - having worked at a company in prod environments - Operationalize and productionize of systems having worked on both
Data pipeline experience
Software engineering in Big Data experience
Ad targeting business domain experience.

Reference : Software Engineer- Pipeline Engineer jobs

Useful information

  • Avoid scams by acting locally or paying with PayPal
  • Never pay with Western Union, Moneygram or other anonymous payment services
  • Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
  • This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"


post to multiple job boards
Now take benefits of multiple job boards and search engine posting.
Try it.

Related listings