Data Engineer

Start Date: ASAP
Contract Length: 6 months
Hours: 37 hours per week
IR35 Status: Outside IR35
Location: Edinburgh-based, hybrid working (primarily remote with occasional onsite activities).
Rate: £450 per day
Basic disclosure Scotland required at the cost of £25 if successful

Role Overview:

Our client is seeking an experienced Data Engineer to support the development of a Data Warehouse and associated data solutions. The role involves streamlining data processes, migrating workflows to AWS, and delivering resilient data integration and automation.

Key Responsibilities:

• Develop solutions for customer data products and reports.
• Migrate on-premise data processes to AWS cloud.
• Deliver and maintain robust data integration solutions.
• Enhance and support data outputs for internal and external users.
• Collaborate across teams to design scalable solutions.
• Ensure high-quality, maintainable, and secure software practices.

Essential Skills & Experience:

• Expertise in Python, PostgreSQL, REST APIs, SQL, and data transformation.
• Proficiency in CI/CD practices, including Docker, GitLab CI, and AWS tools.
• Experience with Agile delivery models and ETL/data streaming systems.

Desirable Skills:

• Familiarity with AWS Glue, Step Functions, S3, RDS, and PostGIS.
• Knowledge of data warehousing and hybrid on-prem/cloud solutions.
• Experience with monitoring tools like Grafana and test automation frameworks.

This is an excellent opportunity to contribute to a dynamic and collaborative environment, delivering impactful data engineering solutions.