Senior Data Engineer

  • Credit Karma
  • San Francisco, CA, USA
  • Mar 25, 2022
Full time Developer JAVA

Job Description

As a Data Engineer on the Analytics Systems team, you’ll work with a talented team of engineers to improve Credit Karma’s data pipeline that powers our recommendation systems, enterprise tools, and data warehousing.  You’ll help to build a general, secure, scalable, fast, and high throughput data pipeline to process many terabytes of data a day. We are very passionate about performance, correctness, and data quality. The team spends their time day to day developing new pipelines or features that make it seamless for data to be moved throughout our infrastructure.This includes working with cutting edge tools such as Scala, Kafka, Spark, Akka and Google Cloud. We are looking for data engineers at all levels. If you enjoy working in a collaborative environment where everyone can have their say while still being able to set and hit deadlines, then this is the role for you.


  • Work with analysts and data scientists to define processes and standards to inform system design, transform their needs into streaming or batch processing
  • Design infrastructure and systems to scale easily as data ingest grows
  • Implement new data pipeline features with verified high quality from unit test coverage and production monitoring
  • Focus on data quality! Detect data/analytics quality issues and implement bug fixes and data validation for prevention
  • Help understand our day to day operations for continuous improvement of production systems

Our Ideal Candidate

  • 2+ years experience with Big Data technologies (we’re hiring all experience levels)
  • Experience with Scala/Java, Spark, Kafka, or demonstrated ability to pick up new technology quickly
  • Fundamental knowledge about databases and strong SQL skills
  • Familiar with Google Cloud ecosystem such as BigQuery, GCS, DataProc, etc
  • Enjoys working collaboratively; CK’s values include empathy and helpfulness
  • Able to estimate and meet deadlines
  • Excellent verbal and written communication skills

Nice to have

  • Experience working with cloud technologies
  • Experience scaling data throughput or building low latency streaming pipelines
  • Experience solving for data quality