Data Lead/ Architect

Company: Diverse Lynx Llc
Location: Somerville
Posted on: September 13, 2020

Job Description:

Data Lead/ Architect

Somerville

NJ

20-42627

1597873964000

Job Description

Role: Data Lead/ Architect

Location: Raritan, NJ/ Somerville, NJ

Experience(in Years) : 10+

Type: Contract

Role Description:

What success looks like in this role:

We are seeking an experienced Data Lead to lead the development of our data team. In this role, you will lead the design, architecture, create and manage logical data structures designed for flexibility, scalability and resiliency to support current and future business needs. You'll design, build, and maintain processes and components of a data pipeline to support analytics across departments, focusing on data quality and governance, pipeline performance, and best practices for democratized data access. You will also mentor and train new team members on design and development on our data orchestration, ingestion and assimilation process and make recommendations to improve our model.

If you'rea leader with hands on expertisein data engineering, analytics, traditional data warehousing, and/or big data pipeline and processing, you'reexactly who we're seeking. Technical capabilities aside, if you'rea self-starter who's comfortable with ambiguity, able to think bigwithout overlooking minute details,andwho thrives in a fast-paced environment, you're perfect for our team.

Responsibilities:

Lead and participate in the design and development of processes for data integration using NiFi, Airflow and other tools

Design, build, and maintain processes and components of a streaming data pipeline to support near real-time analytics (from requirements to data transformation, data modeling, metric definition, reporting, etc.)

Focus on data quality-detect data/analytics quality issues all the way down to root cause, and implement fixes and data audits to prevent/capture such issues

Design, create and manage logical data structures designed for flexibility, scalability and resiliency to support future business needs.

Qualifications:

10+ years of data engineering experience in data pipeline & processing environments

Strong data modeling and SQL experience

Experience with columnar storage and massive parallel processing data systems

Strong experience with Python, Java, SQL, and/or similar languages

Experience developing programs to parse, process, clean, organize, and analyze large data setsStrong experience with Nifi, Airflow and other relevant tools

Experience with Azure services is helpful

Bachelor's Degree preferred, and/or a minimum of four (4) + related work experience.

3+ years of relevant experience in one of the following areas: Data engineering, database engineering, business intelligence or business analytics.

3+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets.

5+ years of experience in scripting languages like Python etc.

3+ years of experience in Public cloud AWS or Azure

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company. If you'rea leader with hands on expertisein data engineering, analytics, traditional data warehousing, and/or big data pipeline and processing, you'reexactly who we're seeking. Technical capabilities aside, if you'rea self-starter who's comfortable with ambiguity, able to think bigwithout overlooking minute details,andwho thrives in a fast-paced environment, you're perfect for our team., 10+ years of data engineering experience in data pipeline & processing environments Strong data modeling and SQL experience Experience with columnar storage and massive parallel processing data systems Strong experience with Python, Java, SQL, and/or similar languages Experience developing programs to parse, process, clean, organize, and analyze large data setsStrong experience with Nifi, Airflow and other relevant tools Experience with Azure services is helpful Bachelor's Degree preferred, and/or a minimum of four (4) + related work experience. 3+ years of relevant experience in one of the following areas: Data engineering, database engineering, business intelligence or business analytics. 3+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets. 5+ years of experience in scripting languages like Python etc. 3+ years of experience in Public cloud AWS or Azure Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company. 20-42627 1597873964000

Keywords: Diverse Lynx Llc, Somerville , Data Lead/ Architect, Other , Somerville, Massachusetts