Senior Spark Developer

  • Free
  • Published date: July 15, 2021
    • Massachusetts, United States


Job title: Senior Spark Developer (10+ years)

Location: Boston MA but will be remote for now



Years of experience: 10+ years



Required Technologies: Databricks, Spark , HC BG, Strong hands on
builder/engineer BG. Pharma background would be preferred




Job Description:


About the Role:
Do you have a passion for the craft of data engineering at scale and
complexity? Our Engineering team is looking for motivated, versatile, and
naturally curious data engineers that are excited about using cutting edge
cloud technology to better the US healthcare industry. This is a fantastic
opportunity for data engineers looking to architect and build data
ingestion pipelines at scale, and build lossless and foundation data assets
that drive BI and AIML (Artifical Intelligence Machine Learning) insights.
You will Architect and build resilient and scalable data ingestion and
processing pipelines using primarily Spark, in support of producing
fit-for-purpose data assets for powering healthcare analysis and
analytics. These pipelines will curate, adjudicate and master data, and
perform various quality checks to ensure the completeness and correctness
of the data. The data injection framework will have to scale to support Tb
of data with elasticity to keep to SLAs, running on a PaaS that support
Massive Parallel Processing, running on AWS, Azure and GCP. If you are
looking to learn and drive best engineering practices, become an expert in
building scalable, elastic and secure data clouds, and work at an
innovative, fast-paced technology company disrupting the healthcare
industry... you?ve found it.
What We?re Looking For:
? High curiosity and innate problem solving mindset
? Hands-on Architecture experience and willingness
? 10+ years of commercial software development experience or relevant
internships.
? 5+ years of building data processing pipelines at scale
? 3+ years of building data processing pipelines at scale and in
production with Spark
? 3+ years of working with Massive Parallel Processing platforms like
Hadoop/Cloudera and Databricks, Databricks preferred
? 2+ years of building or using cloud services in a production
environment or internship experience (AWS, Azure, GCP, etc).
? Experience building and scaling Data Lakes at Tb-Pb scale and
supporting AIML workloads on them
? Strong analytical, critical thinking, and problem solving skills to
overcome complex, often ambiguous, technical problems.
? Strong programming skills (Python, Scala, Java, or other
OOP/Functional Languages).
? Strong database knowledge in both relational and non-relational
structures
? Challenge the status quo: outside the box problem solving acumen.
? A desire to work in an environment where you will teach and be taught.
? Professionals who thrive when owning problems end-to-end and be
willing to learn the skills and knowledge to accomplish organizational
goals.
? Go-getter with self-starter mindset.
? Stays current with new technology and development techniques
? Excellent oral and written communication skills; strong analytical,
problem solving, organization and prioritization skills
Not required, but nice to have:
? Experience working with healthcare or health insurance data
? Full-stack development experience with UI/UX knowledge.



Reference : Senior Spark Developer jobs

Useful information

  • Avoid scams by acting locally or paying with PayPal
  • Never pay with Western Union, Moneygram or other anonymous payment services
  • Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
  • This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"


post to multiple job boards
Now take benefits of multiple job boards and search engine posting.
Try it.

Related listings

  • Data Engineer with Java

    Technology (Massachusetts) June 14, 2021 Free

    Job Title: Java Data Engineering Hire Type: Contract Location: Boston/Quincy, MA Reference : Data Engineer with Java jobs

  • Store Manager

    Technology (Massachusetts) June 9, 2021 Free

    2020 On-site is the leader in mobile vision care. Since 2014, our Mobile Vision Clinics have provided eye care to over 75,000 patients at their workplaces, schools, and neighborhoods. In May 2020, we expanded our services to provide vital access to c...

  • Administrative Intern

    Technology June 7, 2021 Free

    Description Work Duties: Creating wastewater and storm water rate data entry tools u sing KoBo toolbox Assisting data entry staff in the use of the form Creating R scripts to parse wastewater and storm water rates into monthly bill estimates based on...