Senior Data Engineer

Euro-Testing Software Solutions

  • București
  • Permanent
  • Full-time
  • Acum 8 zile
Short company descriptionEuro-Testing Software Solutions is involved in software consulting, having experience of approx. 20 years on the market in Romania and abroad, through specific IT solutions and services offered in the following areas:
  • Software Testing (manual testing, testing automation, performance testing, outsourcing, training and certification, etc.)
  • Cyber ​​Security
  • DevOps/DevSecOps
  • Implementation and Customization of Atlassian & OpenText products (MicroFocus) and other niche products/solutions
  • AI based Decision Intelligence solutions.
Requirements
  • Design and development of automated data pipelines and data structures
  • 5+ years of working with Python Programming
  • 2+ years hands on data engineering experience for data warehouse solutions using Snowflake, SQL, Airflow or similar
  • Hands on experience with building CI/CD pipelines using GitLab or similar tools.
  • Experience working with Agile Delivery teams (Scrum, Kanban) and JIRA
  • Ability to build automated testing to test data pipelines
  • Up-to-date knowledge of technology standards, industry trends, emerging technologies and software development best practices
Optional/Nice-to-have Skills:
  • Experience with managing infrastructure using terraform
  • Experience with using dbt for data transformation and modelling
  • Experience with kafka event streaming and messaging
Responsibilities
  • As a Senior Data Engineer for the Concorde Platform Team, you will oversee Snowflake platform health, performance, and overall reliability, including troubleshooting ingestion, transformation, and orchestration issues.
  • You will provide support to platform tenants on Snowflake and Apache Airflow, ensuring smooth operations across data pipelines.
  • Develop and maintain an end to end testing framework to safeguard tenant flows during platform changes, while continuously optimizing queries and storage for performance and cost efficiency.
  • Automate operational tasks through GitLab CI/CD pipelines and contribute to a consistent, well-managed release process.
  • Document data architecture, pipeline processes, and best practices, and collaborate with the Snowflake team to evaluate and adopt new tools and frameworks.
  • Actively support the release process to ensure consistent, high quality platform delivery.
Other infoThe Post Trade Division has launched a Data Transformation program called Concorde. The objective is to have a new, centralized, and secure way to manage Post Trade data on cloud native technology in AWS and Snowflake. The operating model is a federated model with Core Engineering teams based in London/Bucharest and Engineers based in each Business division to lead the implementation of tenancies on AWS, Azure and Snowflake.

Hipo.ro