Job Description

Roles & Responsibilities

Duties and Responsibilities:

The Data Engineer will perform the following tasks:

• Design, build, and maintain ETL/ELT pipelines.
• Automate data ingestion from various sources (databases, APIs, streaming services).
• Implement data validation and quality checks.
• Use platforms like Azure for cloud-based data solutions.
• Work with Data Scientists and Full stack Web Developers to provide clean, reliable data.
• Create and maintain comprehensive technical documentation, including user manuals, training materials, and product specifications, also developing functional specifications.
• Provide ongoing support for deployed pipelines including version control, data recovery processes, and deployment strategies.
• Research emerging technologies and industry trends, staying up to date with developments in the field, and actively assisting in testing and evaluating new products, tools, and technologies.

Desired Candidate Profile

A minimum high school diploma with a certification or degree in Information Systems, Information Technology, Computer Science, Statistics or related area is required. All candidates must submit a copy of the required educational degree. Incomplete applications will not be reviewed.

A minimum of 5 years of professional experience with Python, SQL, cloud environments container orchestration (Kubernetes), and DevOps automation is required.

Excellent analytical, problem-solving, and communication skills are required.

Knowledge in database design, and development using MS SQL Relational Database is required.

Strong familiarity with semantic modeling, knowledge graphs, and AI/ML integration for data systems is desirable.