Workbridge Associates: Where People Meet Performance

Senior Data Engineer (Spark) - Big Data Startup

Apply for this job
Share this:

Senior Data Engineer (Spark) - Big Data Startup

Leading big data product startup in San Francisco is hiring two data engineers for a brand-new engineering team that will be developing two yet-to-be-announced products.

These products will accompany the startup’s core product, a self-service big data governance and insights platform that is used by employees at enterprise clients. The platform is essentially an Excel spreadsheet on steroids for non-technical users to parse and manipulate large data sets.

The Senior and Lead Data Engineer will be building streaming ingestion pipelines to connect with data lakes at their clients. These pipelines will bring in new data which is then processed by Spark for analytics.

The company is approaching 1 PB of data. This would be entirely green field development. And you’d use all modern technologies with the language of your choice.

Required Skills & Experience

  • Proficient in Scala, Java, or Python
  • Strong experience with Spark

Desired Skills & Experience

  • Understanding of AWS cloud environment
  • Experience with Kafka, SQS, or similar
  • Exposure to Flink or other streaming big data technologies
  • Experience with Scala
  • MS or PhD in CS or mathematics related discipline

What You Will Be Doing

Tech Breakdown

  • 100% new development in language of choice – some existing Spark jobs in Java
  • 100% open source

Daily Responsibilities

  • End-to-end project-based design and implementation of new ingestion pipelines
  • 100% hands-on, flat hierarchy, first engineers hired for new product team will

The Offer

  • Competitive salary: Up to $200K per year, depending on experience
  • Equity package
  • Well-funded startup with paying Fortune 100 clients
  • New development of two new high-profile products


Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.


Workbridge Associates, part of the Motion Recruitment network, provides IT Staffing Solutions (Contract, Contract-to-Hire, and Direct Hire) in major North American markets. Our unique expertise in today’s highest demand tech skill sets, paired with our deep networks and knowledge of our local technology markets, results in an exemplary track record with candidates and clients.

Apply for this Job

Joe Boys is leading the search for this position. Use the button below to send us your resume and let us know you’re interested in the job!

Apply to this job
Senior Data Engineer (Spark) - Big Data Startup
  • Joe Boys

  • Practice Manager
  • Workbridge San Francisco - SWD
Back to job listings

Great! You're interested!

Use this form to send me your resume, and my team and I will review it for this job:

Senior Data Engineer (Spark) - Big Data Startup

So you know, this isn't the only job like this we're working on. We'll review your resume for every relevant job that comes in!


Apply With This Info
  • Workbridge Associates

Thank you

Your information has been received.

One of our teams will give it a careful look for the Senior Data Engineer (Spark) - Big Data Startup job, and for every other relevant position we’re working on right now, too.
If it looks like we can help you out, you’ll hear from us shortly!

Return to Search Results Close

Send to a Friend

If you know someone who'd be interested in this job, send them a link so they can check it out.

Thank You!

Your note about the position number: 315733 has been sent to your friend

Return to Search Results