Data Engineer
Location: Remote
About D&I
At D&I Integrators, we pride ourselves on being a trusted partner in delivering innovative data solutions that empower businesses to optimize performance and make data-driven decisions. As a forward-thinking technology and consulting organization, we specialize in defining and implementing comprehensive data strategies, streamlining workstreams, and eliminating inefficiencies. Our expertise spans across cutting-edge business intelligence (BI) tools and cloud platforms, helping clients harness their data for actionable insights.
We collaborate with industry-leading platforms like ThoughtSpot, Power BI, Snowflake, and AWS to deliver tailored solutions that meet the unique needs of each organization. Our approach is grounded in accuracy and innovation, which allows us to navigate the complexities of a data-driven world with precision. At D&I Integrators, you’ll be joining a team of passionate experts who are dedicated to helping businesses unlock the full potential of their data.
The Role
We are looking for an experienced and motivated Data Engineer to join our dynamic team. In this role, you will design, develop, and maintain scalable data pipelines and systems that meet the needs of our clients. You will work closely with cross-functional teams, including data scientists, analysts, and other engineers, to ensure data is organized, accessible, and ready for analysis. You will play a key role in shaping how data is used across client projects, contributing to business success through efficient data engineering practices.
Key Responsibilities:
Design, develop, and optimize scalable, high-performance data pipelines and ETL processes to meet the needs of client projects.
Collaborate with data scientists, analysts, and stakeholders to understand data requirements and ensure accurate, efficient data flow.
Build and maintain data infrastructure, ensuring high availability, reliability, and performance of data processing systems.
Work with large datasets across multiple platforms (e.g., Snowflake, AWS, Databricks, Google Cloud) to enable real-time and batch data processing.
Implement data quality monitoring and validation checks to ensure integrity and accuracy of data.
Integrate data from multiple sources (structured, unstructured, and semi-structured) to create comprehensive datasets for analytics and reporting.
Monitor data pipelines and troubleshoot any issues that arise, ensuring smooth operations and timely resolution of bottlenecks.
Develop and maintain documentation for data processes, pipelines, and architectural decisions.
Stay updated with the latest data engineering trends and technologies, contributing to continuous improvement within the organization.
Qualifications:
Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Science, or a related field.
3+ years of experience as a Data Engineer or in a similar role, working with large-scale data processing, ETL pipelines, and cloud platforms.
Strong experience with SQL and databases such as Snowflake, Redshift, or BigQuery.
Proficiency in programming languages like Python, Java, or Scala, with experience in data manipulation and ETL frameworks.
Experience with cloud data platforms such as AWS (Redshift, S3), Azure, Google Cloud, or Databricks.
Hands-on experience with data integration tools and frameworks (e.g., Apache Spark, Kafka, Airflow, or DBT).
Knowledge of data governance, data quality, and best practices in data architecture and security.
Familiarity with BI tools (e.g., ThoughtSpot, Power BI) for creating actionable insights.
Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment.
Excellent communication skills, with the ability to explain complex data concepts to both technical and non-technical stakeholders.
Why Join Us? At D&I Integrators, you will have the opportunity to work on impactful projects across a variety of industries, leveraging cutting-edge technology to drive real business outcomes. We offer a collaborative work environment where innovation, personal growth, and professional development are encouraged. As a Data Engineer, you will be a key player in helping our clients harness the power of their data to drive informed decision-making and optimized performance.
Application Process: If you are passionate about data engineering and want to make a tangible impact in a fast-growing consulting firm, we would love to hear from you! Please submit your resume and a cover letter outlining your relevant experience and why you are excited about joining D&I Integrators.