Data Engineer – Lead
Are you a data professional ready to join a dynamic team cracking the government’s most exhilarating data puzzles? Does the idea of using data to justify the adoption of business transformation excite you? Do you enjoy partnering with decision-makers to understand data insights and develop solutions that help them better control costs, ensure basic accountability, anticipate the future, measure performance, and maintain optimal operations? If so, IVERTIX is the place for you!
IVERTIX is seeking experienced Data Engineer Leads to join our project team. As a Data Engineer Lead, you will play a crucial role in designing, developing, and maintaining our data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in leading and managing efficient data processing and analysis.
Responsibilities:
- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Act as a technology liaison to leadership and facilitate, collaborate, and integrate impactful and advanced technical solutions for large-scale mission impacts.
- Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
- Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
- Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
- Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
- Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
- Maintain documentation for software applications, workflows, and processes.
- Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
Requirements:
- Secret clearance is required; TS/SCI clearance is preferred.
- Minimum of 5-10 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
- High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Experience leading and managing cross-functional technology team.
- Strong problem-solving skills and ability to solve complex data-related issues.
- Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
- Understanding of data modeling/visualization, database design principles, and data governance practices.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Detail-oriented mindset with a commitment to delivering high-quality results.
- Must be in the DC Metro area and available to work onsite (Crystal City, VA and Alexandria, VA) 2-3 days per week.
Nice to Have:
- Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus.
- Recent DoD or IC-related experience.
If you are passionate about leveraging your data engineering lead skills and working with cutting-edge technologies to enable efficient data analysis, we encourage you to apply. Join our team and be a part of our mission to provide streamlined and rapid access to critical information.
Interview Requirements:
- Video Interview – Yes (may include technical assessment)
Interview Prep:
- Candidates should be prepared to clearly articulate their experience creating data-related software applications from scratch (Recent evidence of this should be easily identifiable in their resume).
- Candidates should be prepared to clearly articulate data problems that their applications have solved in their past.
- Candidates should be prepared to discuss what technologies they have hands-on experience with and demonstrate in-depth understanding of those technologies during the technical assessment.
- Candidates should be prepared to clearly articulate their experience working with very large data sets/Big Data, like that of large federal agency.
- Candidates should be prepared to clearly articulate their proficiency with data and software-related programming languages and explain their thought processes related to problem solving.
- Candidates should be prepared to discuss their onsite availability.
Fully Remote Option:
- Fully remote work schedules are not currently available.
Clearance Sponsorship:
- Clearable – US Citizens