Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...Job Description Job Description We are looking for a detail-oriented HR Administrative Assistant to support daily operations within the HR department. This is a long-term contract position based in Collierville, TN, offering an excellent opportunity to contribute to...
...has prioritized the generation and delivery of high-quality Patient Experience Data (PED) by building a suite of Clinical Outcome Assessment... ...individuals to join our team. The Role of the Associate Director - Patient Experience Data: IQVIA is currently consolidating...
...Join to apply for the Fleet And Safety Manager role at Incredible Adventures 1 day ago Be among the first 25 applicants Join to apply for the Fleet And Safety Manager role at Incredible Adventures Incredible Adventures has been offering travelers a safe and...
...and their own careers. Whether you're a real estate veteran, a passionate technologist, or... ...functions of Deutsche Bank's substantial commercial and multifamily real estate financing... ...sponsor due diligence (KYC) Writing internal investment summaries and credit memos...
To be considered for this role, applicants must hold a bachelors degree before starting first day of work with Success Academy - a background in education is not required. Thanks for your interest in Success Academy! Running the largest, fastest-growing, and highest...