Find your next tech and IT Job or contract role.

Data Engineer Location: RG7 4PR , located between Reading and Basingstoke, with free onsite parking . Package: £38,350 - £50,000 (depending on your suitability, qualifications, and level of experience) Working pattern: AWE operates a 9-day working fortnight. Let us introduce the role AWE is currently recruiting for 2 Data Engineer's/Analyst's for the IS Modernisation group. Responsibilities: Learn how to use best-in-class data integration software that is recognised across industry. Work closely with internal customers to understand their greatest problems and design and implement data-driven solutions using the Foundry platform. Take ownership of high-stakes projects, leading end-to-end execution with small teams. Engage in architectural discussions with fellow engineers to drive effective solutions. Wrangle massive-scale data, ensuring its quality and usability. Develop custom web applications to provide user-friendly interfaces for data access and analysis. Collaborate efficiently with both technical and non-technical individuals in a dynamic environment with evolving objectives and user iteration. What We Value: A highly analytical approach and a keen desire to solve technical problems using data structures, storage systems, cloud infrastructure, front-end frameworks, and other technical tools. Experience or curiosity about working with and utilizing large-scale data to tackle valuable business problems. Ability to collaborate effectively in teams with individuals from both technical and non-technical backgrounds. A self-starter with ability to get stuck into complex problems to find real business value and require little oversight, comfortable with making decisions on the edge in line with the team's objectives and values. Comfortable working in a dynamic environment with evolving objectives and a focus on iteration with users. Who are we looking for? We do need you to have the following: Strong engineering or analytical background, preferably in fields such as Computer Science, Mathematics, Software Engineering, Physics, or Data Science/Analytics. Proficiency in at least one programming language such as Python, Java, C++, TypeScript/JavaScript, or similar. Whilst not to be considered a tick list, we'd like you to have experience in some of the following: Hands on experience with Foundry Some reasons we think you'll love it here: AWE has wide range of benefits to suit you. These include: 9-day working fortnight - meaning you get every other Friday off work, in addition to 270 hours of annual leave. Market leading contributory pension scheme (we will pay between 9% and 13% of your pensionable pay depending on your contributions). Family friendly policies: Maternity Leave - 39 Weeks Full Pay and Paternity Leave - 4 Weeks Full Pay. Opportunities for Professional Career Development including funding for annual membership of a relevant professional body. Employee Assistance Programme and Occupational Health Services. Life Assurance (4 x annual salary). Discounts - access to savings on a wide range of everyday spending. Special Leave Policy including paid time off for volunteering, public service (including reserve forces) and caring. Policy including paid time off for volunteering, public service (including reserve forces) and caring. The 'Working at AWE' page on our website is where you can find full details in the 'AWE Benefits Guide'. Due to the classified nature of the work involved, there are limited opportunities to work from home in this role. It is anticipated that the successful candidate will spend the majority of their time working on site at AWE Aldermaston. Our ambition is to create workplaces where we recognise and celebrate differences, encourage diverse contributions and our employees feel able to be themselves at work. We strive to create a genuine culture of openness and inclusion and encourage diverse applicants. Any inclusion information you provide will be stored in accordance with GDPR and kept separate from your application form and CV, and the information will not be shared with anyone involved in interviewing or making hiring decisions. Next steps: Everyone who works at AWE brings unique skills and perspectives to the table. We recognise that great people don't always 'tick every box'. That's why we focus on your potential, your fit with our values, your transferable skills as well as your experience. Even if you don't meet every point above, but you feel that this role and AWE are a great fit for you, please go ahead and apply, we'd love to receive your application. Important things you need to know: We encourage you to apply promptly to avoid disappointment if applications are high and the role therefore closes. You will need to obtain and maintain the necessary security clearance for the role. This will be funded by AWE. The nature of our work does mean you need to be a British Citizen who has been resident in the UK for the past 5 years in order to apply for SC clearance and 10 years for DV. We want you to feel comfortable and able to shine during our recruitment process. Please let us know on your application form if you need any adjustments/accommodations during the process. Our interviews typically take place over Teams and for most roles are a 1 stage process. #LI-AT

Data Engineer Junior to Mid-Level London - 4 Days on-site £40,000 - £65,000 DOE + Equity + Unlimited Annual Leave This is an excellent opportunity for a Junior Data Engineer to join a rapidly growing start-up offering great progression and the chance to further enhance your skills. This company is a platform designed to simplify the hiring process for businesses and enable individuals to find flexible work opportunities. By connecting businesses with skilled professionals for short-term staffing needs, this innovative solution optimises workforce efficiency. In this varied role you will be responsible for building and maintaining scalable data pipelines for data integration into customer-facing mobile and web apps, as well as internal dashboards. Responsibilities include designing and implementing data architecture to optimise data storage, retrieval, and processing, alongside developing ETL processes to ingest, transform, and load data from various sources, particularly APIs. The ideal candidate will possess strong foundations in data architecture with a degree in a relative subject or industry experience. Scalable data solutions, coupled with a solid understanding of data modelling techniques, database design, and data normalisation is required for the role. Equally, proficiency in Python and SQL is essential, ideally with experience using data processing frameworks such as Kafka, NoSQL, Airflow, TensorFlow, or Spark. Finally, experience with cloud platforms like AWS or Azure, including data services such as Apache Airflow, Athena, or SageMaker, is essential for the Mid-level. This is a fantastic opportunity for a Junior Data Engineer to join a rapidly expanding start-up at an important time where you will have great progression opportunities. The Role: • Build and maintain scalable data pipelines.Design/implement optimised data architecture.Develop ETL processes for various data sources.Integrate data for apps and dashboards. The Person: • Strong data architecture foundation (degree/experience).Scalable data solutions & data modelling expertise.Proficient as a Data Engineer with Python, SQL, and data frameworks.AWS/Azure experience with relevant data services. Reference Number: BBBH251710 To apply for this role or for to be considered for further roles, please click \"Apply Now\" or contact Tom McLaughlin at Rise Technical Recruitment This vacancy is being advertised by Rise Technical Recruitment Ltd. The services of Rise Technical Recruitment Ltd are that of an Employment Agency Rise Technical Recruitment Ltd regrets to inform that our client can only accept applications from engineering candidates who have a valid legal permit or right to work in the United Kingdom. Potential candidates who do not have this right or permit, or are pending an application to obtain this right or permit should not apply as your details will not be processed.

Location(s): London or Manchester BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. Job Title: Data Engineer Requistion ID: 120494 Location: London or Manchester - Hybrid working offered, with consideration for both full and part-time applicants - please speak to your recruiter about options Grade: GG08 - GG13 We are looking for experienced Data Engineers to join our team following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces Model data requirements, data sources and data flows to bring order and structure to programmes of work Defining how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data assets Using categories of products that can be used to collect, integrate, store, visualise and govern data and metadata Define metadata to provide search ability and governance (including Records Management) for unstructured data. Not only will your team be directly making a huge impact upon the systems you work on, you'll be doing it for an organisation who makes a huge impact to the security of the UK. About you You will have experience in many of the following: Data Engineering, Analysis or Science, with a solid understanding of programming languages along with experience of applying them in your previous role Experience in using Data Engineering tools and technology ETL tools including Python and a number of the Big Data Applications. Rather than specifying a list of technologies we look for, demonstrable ability in what you have used previously, along with adaptability and willingness to learn is what we value A good understanding of Open Source software for Data Engineering and can evaluate these platforms against products. Given a customer problem you can analyse and evaluate options and recommend solutions. An understanding of maintaining and applies up to date, specialist knowledge of database concepts (including unstructured, NoSQL and "big data" platforms), object and data modelling techniques. Previous experience working in the domain of Cyber Security and Intelligence is desirable, but not essential. Applicants will need to be eligible to work in the UK and hold an active eDV UK security clearance. How we will support you Work-life balance is important; you can work around core hours with flexible and part-time working, and many of our roles include hybrid working enabling a mix of working from home and in the office Youll get 25 days holiday a year and the option to buy/sell and carry over from the year before Our flexible benefits package includes private medical and dental insurance, a competitive pension scheme, cycle to work scheme, taste cards and more Youll have a dedicated Career Manager to help you develop your career and guide you on your journey through BAE Youll be part of our company bonus scheme You are welcome to join any/all of our Diversity and Support groups. These groups cover everything from gender diversity to mental health and wellbeing. About our team Our people are what differentiates us, they are resourceful, innovative and dedicated. We have a mix of generalists and specialists and recognise that this diversity contributes to our success. We recognise the benefits of forming teams from a mix of disciplines, which allows us to come up with cutting edge, high quality solutions. Our breadth of work across the Public Sector provides diverse opportunities for our people to develop their careers in new areas of expertise and with new clients. You'll be part of a big company, but we try to create a culture that feels like a small one. The work will stretch you and be challenging, but we encourage a healthy work-life balance. Most of all, we know teams who work well together also perform well. We'll do everything we can to ensure you have fun at work, and in social activities outside of it whether that's virtually or in person, as conditions allow. We have a rich history of working within National Security. In fact, we have over 40 years' experience of delivering advice and solutions to our customers in this sector, supporting them in carrying out their vital missions. Life at BAE Systems Digital Intelligence We are embracing Hybrid Working. This means you and your colleagues may be working in different locations, such as from home, another BAE Systems office or client site, some or all of the time, and work might be going on at different times of the day. By embracing technology, we can interact, collaborate and create together, even when we're working remotely from one another. Hybrid Working allows for increased flexibility in when and where we work, helping us to balance our work and personal life more effectively, and enhance well-being. Diversity and inclusion are integral to the success of BAE Systems Digital Intelligence. We are proud to have an organisational culture where employees with varying perspectives, skills, life experiences and backgrounds - the best and brightest minds - can work together to achieve excellence and realise individual and organisational potential. Division overview: Capabilities At BAE Systems Digital Intelligence, we pride ourselves in being a leader in the cyber defence industry, and Capabilities is the engine that keeps the business moving forward. It is the largest area of Digital Intelligence, containing our Engineering, Consulting and Project Management teams that design and implement the defence solutions and digital transformation projects that make us a globally recognised brand in both the public and private sector. As a member of the Capabilities team, you will be creating and managing the solutions that earn us our place in an ever changing digital world. We all have a role to play in defending our clients, and this is yours.

Lead Data Engineer Charlottesville, Virginia - remote working US based (East Coast preferred) $150,000 to $170,000 depending on experience + Medical, Dental, Maternity Leave, Vision, Paternity, 401k Excellent opportunity for a Lead Data Engineer with expertise in Microsoft Azure to join an established, successful, growing company in a highly varied and interesting role where they put a large emphasis on the welfare of their employees. This is a financially strong and stable software company that is going from strength to strength as they grow and upscale, they can offer unique opportunities for their staff to develop and progress. They want to give people more than a job, they want to offer a purpose and a career where you can develop, upskill, train and progress. Through growth, they are looking to add Lead Data Engineer to be a hands-on technical expert and leader to their small but growing team. In this role you will play a pivotal role in advancing the analytics capabilities within the company. This is a remote working role; however, you must be living in the USA and not require a visa to be employed. East Coast time zone is preferred. The ideal candidate will be an experienced Data Engineer with strong Microsoft Azure expertise and leadership experience (either technical leadership, or hands on management). This is a fantastic opportunity to join a financially strong and stable, growing organization in an exciting role where you will be treated well and given opportunities to progress and develop. The role: *Data platform leadership *Data transformation design *Data pipeline development *Data storage solutions *Performance tuning *Mentoring and being a technical leader *Documentation *Remote working, US based The person: *Experienced Lead Data Engineer with strong Microsoft Azure expertise *Data Modeling and Warehousing experience *Experience of Pipeline Construction and Orchestration *Deep knowledge of ETL and ELT, particularly using Azure Data Factory *Leadership experience, either technical leadership or direct management *Experience with the following is beneficial - Streaming data processing, Data processing patterns, SQL & Data manipulation, Analytical problem solving, Programming skills, CI/CD implementation, Databricks

Location(s): UK, Europe & Africa : UK : Leeds BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. Job Title: Data Engineer Location: Leeds - We offer a range of hybrid and flexible working arrangements - please speak to your recruiter about the options for this particular role. Grade: GG09-GG10 Referral Bonus: £5000 What You'll Be Doing: CPS engaged Mobilise to embark upon a discovery/proof-of-concept for business intelligence/data warehouse over 4 years. This period was interspersed with multiple breaks whilst CPS re-prioritised and determined next steps. Mobilise helped CPS gain a better understanding of the technology options suitable for the CPS's desired technology roadmap/ecosystem by putting in place a proof-of-concept which showcased an end-to-end capability and vision of 'what' and 'how' CPS's vision could be realised. Working together and using an agile delivery methodology CPS gained a richer and deeper understanding of its own organisations data and learnt more about the Microsoft technology stack allowing them to improve their internal reporting and their understanding of their business. CPS now wish to transform a PoC solution into a fully productionised and supported system. This is anticipated to be achieved using one or more agile teams in a phased approach to deliver key technology deliverables on their enhancement journey. Skills & Experience: Azure Data Factory (ADF) Create dimensions incrementally, reducing processing and data needs with a hopeful reduction in the incurred costs for compute, data and network processing. Changing the authentication method between ADF and SQL Server to use either a managed identity or service principal to enhance security and manageability. Establishing parallelism within existing and new ADF pipeline activities. Template elements of an existing pipeline to support the ingestion of new datasets through the platform Azure SQL Integrating Database Access with Microsoft Entra ID for enhanced security. Implementing STAR schemas on Data Models. Establishing naming conventions for database objects. Transitioning data processing from Power BI to Azure SQL. Segregating data serve level data into multiple schemas or views. Data segregation and redaction techniques, such as data masking and data pseudonymisation. Benefits: As well as a competitive pension scheme, BAE Systems also offer employee share plan, an extensive range of flexible discounted health, wellbeing and lifestyle benefits including including a green care scheme, private health plans and shopping discounts - you may also be eligible for an annual incentive. Why BAE Systems? This is a place where you'll be able to make a real difference. You'll be part of an inclusive culture which values diversity, rewards integrity and merit, and where you'll be empowered to fulfil your potential. We welcome candidates from all backgrounds and particularly from sections of the community who are currently under-represented within our industry including women, ethnic minorities, people with disabilities and LGBTQ+ individuals. We also want to make sure that our recruitment processes are as inclusive as possible. If you have a disability or health condition (for example dyslexia, autism, an anxiety disorder etc.) that may affect your performance in certain assessment types, please speak to your recruiter about potential reasonable adjustments. Please be aware that many roles at BAE Systems are subject to both security and export control restrictions. These restrictions such as your nationality, any nationalities which you previously may have held and your place of birth can restrict the roles you are able to perform within the organisation. All applicants must as a minimum achieve Baseline Personnel Security Standard. Many roles also require higher levels of National Security Vetting where applicants must typically have 5 to 10 years of continuous residency in the UK depending on the vetting level required for the role, to allow for meaningful security vetting checks. Life at BAE Systems Digital Intelligence We are embracing Hybrid Working. This means you and your colleagues may be working in different locations, such as from home, another BAE Systems office or client site, some or all of the time, and work might be going on at different times of the day. By embracing technology, we can interact, collaborate and create together, even when we're working remotely from one another. Hybrid Working allows for increased flexibility in when and where we work, helping us to balance our work and personal life more effectively, and enhance well-being. Diversity and inclusion are integral to the success of BAE Systems Digital Intelligence. We are proud to have an organisational culture where employees with varying perspectives, skills, life experiences and backgrounds - the best and brightest minds - can work together to achieve excellence and realise individual and organisational potential.

Data Engineer Skills and Technologies Data Engineering: - Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc - Strong understanding of complex JSON manipulation - Experience working with Data Pipelines using a custom Python/PySpark frameworks - Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. - Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets - Strong problem solving and analytical skills, particularly able to demonstrate these intuitively Required skills:Languages / Frameworks - JSON - YAML- Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.) - SQL - PySpark - Delta Lake - Bash (both CLI usage and scripting) - Git - Markdown - Scala (bonus, not compulsory) - Azure SQL Server as a HIVE Metastore (bonus) Technologies - Azure Databricks - Apache Spark - Delta Tables - Data processing with Python - PowerBI (Integration / Data Ingestion) - JIRA Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.

* Experience with data analytics tools such as Grafana and Talend* API-level connectivity management* Strong SQL skills (Oracle DB, MySQL)* Experience with Denodo, AWS S3, Berlin Job Scheduler, Pentaho* Familiarity with DevOps tools like GitLab* Prior live service support within a Service Management environment* Agile/iterative engineering experienceDue to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.

Lead Data Engineer Remote UK £75,000 - £90,000 + Progression + Pension An excellent opportunity awaits an experienced Data Engineer/Architect looking for a hands-on lead role where you will take ownership of and lead the data solutions, with progression, autonomy, and great growth potential This company is an established business focused on operational and management solutions, specialising in monitoring services. In this role, you will join the existing data team and lead the design, build, and delivery of the company's data solutions. You will take ownership of the data architecture, including modelling and warehousing, and work closely with senior stakeholders to define data strategy, governance, and structure. This is a remote position based in the UK. The ideal candidate will have extensive experience working in the Azure Data stack, with Azure Data Factory and Azure Synapse, designing and implementing ETL/ELT pipelines, data modelling, and building scalable data architecture. The right candidate for this role will have a strong understanding of the operational and commercial implications of data-driven decision-making and will play a key role in driving this within the business. This is a fantastic opportunity for an experienced Data Engineer/Architect looking to play a leading role in an exciting position offering great growth, autonomy, and progression opportunities. The Role: *Hands on Lead focusing on Data Architecture, Build and Delivery *Define Data Strategy, Governance and Structure *Lead the development and maintenance of data models and warehousing *Remote based role in the UK The Person: *Strong experience in Data Architecture, Engineering, and Warehousing within the Azure Stack *Hands-on experience with Azure Data Factory, Azure Synapse, and data pipelines *Ability to make data-driven decisions based on commercial and operational implications *Based in the UK Reference Number: BBBH 250656 To apply for this role or for to be considered for further roles, please click \"Apply Now\" or contact Marcel Cerek at Rise Technical Recruitment. Rise Technical Recruitment Ltd acts as an employment agency for permanent roles and an employment business for temporary roles. The salary advertised is the bracket available for this position. The actual salary paid will be dependent on your level of experience, qualifications and skill set. We are an equal opportunities employer and welcome applications from all suitable candidates.

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for 1 mid level Data Engineer ideally with Fabric experience as they set up an exciting new project team within the global group. This would suit a good mid level Data Engineer looking to join a new, growing team with plenty of exciting projects and cutting tech on the horizon. This will be a mostly remote role but would suit someone near Liverpool as there will be ad hoc travel into the office when required for onsite meetings, workshops etc. A salary of £55k - £65k is on offer, with some potential flexibility for the right person. Responsibilities: Design, develop, and maintain scalable and efficient data pipelines using Microsoft Fabric components (Data Factory, Synapse Data Engineering, Dataflows Gen2).Extract, transform, and load (ETL/ELT) data from diverse sources, including ERP systems, databases, APIs, and flat files, into the Fabric Lakehouse.Implement data quality checks and validation processes to ensure data accuracy and reliability.Design and implement data models and schemas within the Fabric Lakehouse to support analytical and reporting requirements.Manage and maintain data security and access controls within the Fabric environment.Develop data transformations using relevant technologies within Fabric Synapse Data Engineering.Collaborate with data analysts and business stakeholders to understand data requirements and translate them into technical specifications. Develop data models for reporting and analytical purposes. Monitor data pipeline performance and identify areas for optimisation, as well as troubleshoot and resolve data-related issues.Implement monitoring and alerting solutions to ensure data pipeline reliability.Work closely with other data engineers, data analysts, and business stakeholders.Document data pipelines, data models, and other technical specifications.Communicate effectively with team members and stakeholders. Requirements: 2 or more years proven experience as a Data Engineer, preferably with the Microsoft stack.Strong understanding of data warehousing concepts and principles.Hands-on experience with Microsoft Fabric, including Data Factory, Synapse Data Engineering, and Dataflows Gen2 would be highly beneficialProficiency in SQL and Spark (Scala, Python, or SQL), plus ETL/ELT processes and tools.Good knowledge of data quality and data governance principles.Experience with Power BI for data visualisation and reporting is a plus. If you are interested please click apply and share your CV.

Broster Buchanan is partnered with a leading retail goods supplier who is looking for an Integration and Data Engineer to join at a pivotal point of business growth and expansion. This is an exciting new role that will lead the design and implementation of the integration solution to enable proper data utilisation as part of the wider digital transformation. The role is being offered with a salary of £60k - £70k and would require someone near Alconbury, near Huntingdon, as the role will be onsite 3 days per week on average with core hours of 8 - 5 Monday - Friday. Responsibilities: Lead the evaluation, design, and analysis for the implementation of integration architecture based on business requirements, business capabilities, value-stream,s and enterprise standards. Manages and develops the integration architecture for all projects, working closely with system managers, 3rd parties and analysts to ensure an integrated ecosystem. Develop a roadmap for the evolution of the enterprise integration platform. Ensures that business processes that span multiple platforms are integrated and the movement of data is undertaken with accuracy and resilience. Ensure data is available to the right system, at the right time, with the appropriate level of security. Ensure data requirements are captured, and that there is a data repository that provides analytics and reporting capabilities to enable the usage of data as an asset. Work with the architecture team to design and deliver a data repository to meet business requirements with structured and controlled data ingestion processes to accurately store data. Requirements: A strong background in some of the following, Integration architecture, integration development, middleware, database / data lake management or cloud integration development. Ability to deliver solutions within the appropriate framework and methodology whilst ensuring the supportability of services delivered. Good understanding of strategic and emerging technology trends, and the practical application of existing and emerging technologies to new and evolving business and operating models. Experience developing architecture blueprints, strategies, and roadmaps. Experience working with ETL (Extract-Transform-Load) Pipelines. Knowledge of Middleware technologies (iPaaS) or Microservice architecture. Ability to design and deliver integrations in the selected Middleware technologies. Experience integrating Web Services (Scribe, SOAP, REST, JSON, XML) Knowledge of backend development languages such as Java, C#, PHP or Python. Knowledge of some database technologies such as MS SQL Server, T-SQL, SSIS, MySQL, MongoDB, or Snowflake. Knowledge of various aspects of technology architecture like integration, networking, data, API, and security. Knowledge of information principles, processes, and Master Data Management (MDM). Understanding and knowledge of IT service management (ITSM) and Information Technology Infrastructure Library (ITIL). You will also need a strong understanding or real project experience in integration tools such as Boomi, Mulesoft, or Azure Integrations Service. If you are interested please click apply and share your CV.

Data Engineer (DV Security Clearance) Position Description Elevate your potential with CGI, a global technology service provider and premier business consultancy recognized by Forbes Magazine as a top 100 employer. Our mission is rooted in evolution, excelling in intricate challenges. Collaborating directly with our clients, we employ innovative technologies to revolutionize, empower, safeguard, and deliver critical mission systems. We are looking for a Senior Software Developer to come and join our Secure Innovation & Advisory area which sits within the Space, Defence and Intelligence business unit here at CGI. The Space, Defence and Intelligence business unit in CGI is a true IT Systems Integrator. We work, build and operate bespoke, technically complex, mission-critical systems which help our clients keep us all safe and secure. We bring innovation to our clients using proven and emerging technologies, agile delivery processes and our deep expertise across the breadth of space, defence, intelligence, aerospace and maritime, all underpinned by our end-to-end cyber capability. We work collaboratively with global technology companies, cutting edge SMEs and academia to deliver the optimal solution for each client. CGI was recognised in the Sunday Times Best Places to Work List 2024 and has been named one of the 'World's Best Employers' by Forbes magazine. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you'll be part of an open, friendly community of experts. We'll train and support you in taking your career wherever you want it to go. All applicants must hold or be prepared to undergo National Security Vetting (NSV) Security Check (DV) level Your future duties and responsibilities We are seeking a motivated and enthusiastic Data Engineer to join our team in Basingstoke. This role will be pivotal in driving the collection, formatting and integrity of our data, with a focus on advancing data collection, processing, and storage using cutting-edge distributed systems. Ideal candidates will have a keen interest in Cyber Security or Big Data. Key Responsibilities: • Modernise Data Infrastructure: Develop and enhance data collection, processing, and storage systems using advanced distributed technologies, including Kafka, Kubernetes, Zookeeper, and HDFS. • Automate Release Processes: Improve reproducibility, testability, and quality of our releases by automating release processes. Knowledge of Ansible and Azure DevOps is highly beneficial. • Collaborate Cross-Functionally: Work closely with various teams to understand and meet their security and data requirements, ensuring that our development aligns with their operational needs. • Ensure Data Integrity: Maintain high data integrity and correct formatting as you parse, ship, and audit data, handling thousands of data points per second. Required qualifications to be successful in this role Technical Background: oKnowledge of distributed data systems, with experience in tools such as Kafka, Kubernetes, Zookeeper, and HDFS. oProficiency in Linux, specifically Red Hat Enterprise Linux (RHEL). oFamiliarity with SIEM platforms (especially ArcSight) or legacy Java-based applications is a plus. • DevOps Mindset: An understanding of DevOps principles, with hands-on experience automating releases using Ansible. Programming and Data Skills: oProficient in SQL, Python, or other similar languages with experience working in Agile environments. oUnderstanding of data integrity and audit practices, with the ability to collect, parse, and format large volumes of data for security operations. • Security Knowledge: A background in Cyber Security, ideally to the level of CompTIA Security+, is an asset. Preferred Experience: • Experience with Big Data environments and an understanding of security operations. • Strong communication and collaboration skills to support cross-functional project delivery and meet organisational security requirements. #LI-UKA #LI-SB2 Together, as owners, let's turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because... You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction. Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. Come join our team-one of the largest IT and business consulting services firms in the world.

???? Exciting Opportunity in Health Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Reporting To: Vice President of Software Development Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with cutting-edge technology? If so, we have an exciting new role for you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalize clinical research applications. This is your chance to make a meaningful impact on healthcare while working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionizing clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high-performance data pipelines and REST APIs that drive AI applications and external data integrations. Your Role As a Data Engineer, you will: • Build and Optimize Data Pipelines: Implement high-performance data pipelines for AI applications using Databricks.Develop REST APIs: Create REST APIs required for seamless external data integrations.Ensure Data Security: Apply protocols and standards to secure clinical data in-motion and at-rest.Shape Data Workflows: Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable. Key Responsibilities • Data Engineering with Databricks: Utilize Databricks to design and maintain scalable data infrastructure.Integration with Azure Data Factory: Leverage Azure Data Factory for orchestrating and automating data movement and transformation.Python Development: Write clean, efficient code in Python (3.x), using frameworks like FastAPI and Pydantic.Database Management: Design and manage relational schemas and databases, with a strong focus on SQL and PostgreSQL.CI/CD and Containerization: Implement CI/CD pipelines and manage container technologies to support a robust development environment. Requirements • Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow.Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration.Clinical Data Security: Understanding of protocols and standards related to securing clinical data.Python Proficiency: Strong skills in Python (3.x), FastAPI, Pydantic, and Pytest.SQL and Relational Databases: Knowledge of SQL, relational schema design, and PostgreSQL.CI/CD and Containers: Familiarity with CI/CD practices and container technologies.Data Modeling and ETL/ELT: Experience with data modeling, ETL/ELT processes, and data lakes. Why Join Us? • Innovative Environment: Be part of a team that is pushing the boundaries of health tech and clinical research.Career Growth: Opportunities for professional development and career advancement.Cutting-Edge Technology: Work with the latest tools and platforms in data engineering.Impactful Work: Contribute to projects that have a real-world impact on healthcare and clinical research. If you are a versatile Data Engineer with a passion for health tech and innovation, we would love to hear from you. This is a unique opportunity to shape the future of clinical research with your expertise in data engineering. ???? Shape the Future of Health Tech with Us! Apply Today! ???? To find out more about Computer Futures please visit XX XX XX XX XX Computer Futures, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC387148 England and Wales

Build Advanced Analytics & Insights: Develop tools for portfolio performance tracking, alerting, and potential tax or compliance reporting, providing users with actionable insights into their Oil & Gas portfolios.Create Unified Portfolio Dashboards: Design and implement systems to aggregate data from exchange accounts and non-custodial wallets into a single, intuitive dashboard.Enable Smart Trading: Build portfolio features that allow users to execute trades at the best available prices, leveraging aggregated market data and advanced routing.Ensure Scalability and Performance: Architect and maintain high-performance systems capable of processing data from a wide range of sources in real-time.Lead and Mentor the Engineering Team: Manage and inspire a team of engineers, fostering a culture of collaboration, innovation, and professional growth.Stay Ahead of Oil & Gas Trens, Continuously research and integrate emerging technologies and best practices to keep our products at the cutting edge.Skills: Core Java, Python, React, Kuberenetes, AWS. To find out more about SThree, please visit -hidden link- SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC387148 England and Wales

About Our Client: Our client is a Digital & AI Consultancy that work to provide collaborative, enduring, and exquisite support to its clients. Powering Digital Transformation, supporting innovation sprints whilst enduring capabilities to realise competitive advantage and sustained value for their clients.Role Overview This role offers a fantastic opportunity for growth and impact within a rapidly growing company, using the absolute best in Software and Technology.* Objective: Solve user problems by integrating data into a foundational model and creating workflows that enhance decision-making within enterprises.* Environment: Work with experienced and early talent engineers on diverse projects, gaining firsthand experience in data management, analysis, and AI technologies.Technical Skills Understanding a level of familiarity with Palantir (expert to aware of the name to nothing) and which product suite (Foundry, Gotham, AIP) will be important.* Decomp of customer problems into operational workflows including database and UI design* Data Engineering experience, familiarity with Pysark * Typescript Skills* API/Data Connection Skillsets* REACT skills. * Experience of PowerBI, Tableau would be noted for visualisation skills but not an applicable skillset.* Specialist skills in model deployment, optimisation models, and prompt engineering are of interest.* This role seems perfect for someone enthusiastic about technology and eager to make a significant impact.Key Responsibilities* Solution Design: Decompose and design solutions based on client problem sets and data exploration.* Data Pipeline Development: Assist in designing, developing, and maintaining data pipelines and ETL processes.* Workflow Creation: Build and edit operational workflows, including front ends and decision-support tools using Palantir and integrated front ends.* AI Implementation: Collaborate to implement AI and machine learning models to address user problems.* Continuous Learning: Engage in personal development and contribute to the clients Lab for technical and best practice reach back, including upskilling peers or junior engineers.* Client Engagement: Build deep, sustainable relationships with clients, positioning yourself/us as their \"trusted advisor.\"LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.

Data Engineer - Southampton - hybrid - 2 days on site per week - Salary: £35,000- £45,000 Plus, Company Shares, Cycle Initiatives and Private Healthcare VIQU have partnered with a Software as a Service company who are seeking a Data Engineer. This role will be working within an AGILE/SCRUM project management framework which will ensure rapid development cycles, continuous improvement, and a dynamic environment where your contributions will be get the most out of the data ingestion and processing tools. As a Data Engineer you will be performing translation and load operations to ingest data and improve data quality. You will also be willing to research and prototype new methods and technologies to take the companies solution to the next level. Key responsibilities of the Data Engineer • Managing, storing and manipulating data. • Using cloud IaaS and distributed compute to enhance the performance of ETL and data modelling tasks. • Shipping new code regularly and match existing development cycles. • Creating autonomous solutions to everyday problems that enhances the SaaS data handling capability of our software. • Connecting to fleet telemetry via APIs and source vehicle operational data to drive models. • Demonstrating innovation whilst working in a start-up environment. • Communicating technical results to a variety of audiences. Key requirements of the Data Engineer • Background in a STEM-related discipline. • 1-3 years of experience in a data analyst capacity. • Experience working with geographic / geospatial and time-series datasets. • Experience of scripting languages such as Python (or Pandas,Psypark). • Experience of using First Touch API. • Understanding of common data exchange formats. • Experience of working with files, databases and databricks. • Confident working in a small team as well as independently. • Confident in a start-up environment and willing to demonstrate innovation. • An understanding of common API architectural styles (desirable) To discuss this exciting opportunity in more detail, please APPLY NOW for a no obligation chat with your VIQU Consultant. Additionally, you can contact Phoebe Rees on If you know someone who would be ideal for this role, by way of showing our appreciation, VIQU is offering an introduction fee up to £1,000 once your referral has successfully started work with our client (terms apply). To be the first to hear about other exciting opportunities, technology and recruitment news, please also follow us at ‘VIQU IT Recruitment' on LinkedIn, and Twitter: @VIQU_UK Data Engineer - Southampton - Salary: £35,000- £45,000 Plus, Company Shares, Cycle Initiatives and Private Healthcare

SC ClearedRemoteStrong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc- Strong understanding of complex JSON manipulation- Experience working with Data Pipelines using a custom Python/PySpark frameworks- Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.- Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets- Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve)- Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc)- Fundamental linux system administration knowledge - ssh keys and config etc, Bash CLI and scripting, Environment variables- Experience using browser based IDEs (Jupyter Notebooks, RStudio etc)- Experience working in a dynamic Agile environment (SAFE, scrum, sprints, JIRA etc)Languages / Frameworks- JSON- YAML- Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)- SQL- PySpark- Delta Lake- Bash (both CLI usage and scripting)- Git- Markdown- Scala (bonus, not compulsory)- Azure SQL Server as a HIVE Metastore (bonus)Technologies- Azure Databricks- Apache Spark- Delta Tables- Data processing with Python- PowerBI (Integration / Data Ingestion)- JIRAPlease send in your latest CV LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.