London, United Kingdom
Internship Explorer
Internship Explorer
A Data Engineer's role is to work closely with clients to understand their requirements to process, store and serve data. An Engineer will commonly work alongside data architect, scientists and analyst to build and support data flows. They will apply concepts from software engineering and DevOps and use data tools from a large and varied data landscape to present and host datasets for downstream consumption. The scope and responsibilities of a data engineer are wide ranging and largely driven by the data maturity of the clients business. A clear understanding of a clients needs are essential to ensuring data engineering outputs are successful, as is the ability to work with other data roles and interact across multiple organisational units. Data Engineers must understand the requirements of data consumers and the broader impact of data across the clients business such that they view their responsibilities through both technical and business perspectives. In this role, you will: - Build, improve and maintain data flows to extract, transform and load data - Follow software engineering and DataOps best practices to rapidly develop and deploy high quality components - Communicate with technical and non-technical people to build trust and rapport across the business. - Work with stakeholder to understand business problems sufficiently to have a clear picture of requirements. - Collaborate effectively within and across teams - Show ability to quickly learn and adapt to evolving data engineering toolsets and techniques - demonstrate core technical skills around SQL, Python or similar programming languages - demonstrate fundamental skills in data management, orchestration, security and data modelling - setup cloud services to host data infrastructure and store data Data Engineers are also expected to: - Work under general direction within a clear framework of accountability. Exercise substantial personal responsibility and autonomy. Use substantial discretion in identifying and responding to complex issues and assignments as they relate to the deliverable/scope of work. Escalate when issues fall outside their framework of accountability. Plan, schedule and monitor work to meet given objectives and processes to time and quality targets. - Influence customers, suppliers and partners at project level. Make decisions which influence the success of projects and team objectives. May have some responsibility for the work of others. Engage with and contributes to the work of cross-functional teams to ensure that customers and user needs are being met throughout the deliverable/scope of work. Facilitate collaboration between stakeholders who share common objectives. Participate in external activities related to own specialism. - Work includes a broad range of complex technical or professional activities, in a variety of contexts. Investigate, define and resolve complex issues. Apply, facilitate and develop creative thinking concepts or finds innovative ways to approach a deliverable.
