44 data engineer jobs found in Irvine, CA

Senior Data Engineer Location: Remote work (candidate willing to work as per PST) Duration: Full time Senior Data Engineer Location: Remote work (candidate willing to work as per PST) Duration: 6+ months (extendable) Skills: Expertise with SQL, experience with querying/managing tables containing 100M+ records, Postgres, MySQL, Redis, Spark, Scala (nice to have) Experience with various data formats (Parquet, HUDI, etc.) Experience with delta data lake or similar technology.

Hello All, Hope you are doing great. Please go through the job description and let me know your interest. Role: Sr. Data Engineer Locations: Remote Duration: 3 Months Contract to hire Requirement: Client treats Data as Product and our Senior Engineer will be a key member of the engineering staff working across Business Services Engineering, Data Engineering, Platform Engineering, and Infrastructure Engineering to ensure that we provide a fiction-less experience to our customers, maintain the highest standards of protection and availability. Our team thrives and succeeds in supporting Data Driven company and delivering high quality technology products and services in a hyper-growth environment where priorities shift quickly. The ideal candidate has broad and deep technical knowledge in data, typically ranging from front-end UIs through back-end systems and all points in between. Required: 3+ years of experience in data software development, programming languages and...

Title: Remote AWS Data Engineer Terms: Contract Location: 100% Remote (Candidates must be living in the Atlanta area) Are you a proficient AWS Data Engineer seeking your next venture? We have an intriguing opportunity with a Fortune 500 company based in Atlanta. We are searching for a Senior Data Engineer to lead the introduction and implementation of AWS, Spark, and PySpark from scratch. If you're enthusiastic about employing cutting-edge technologies, tackling intricate problems, and having a tangible impact, this might be your ideal role.' From engineering to leading teams, you'll be pivotal in designing and executing advanced analytics capabilities that will allow us to leverage the wealth of our data! How You Will Make an Impact: Lead in the implementation of AWS, Spark, and PySpark, constructing and refining our data infrastructure to fully exploit our data's potential. Design and construct data pipeline architecture for consistent data...

Position:- GCP Lead Data Engineer Type:- Remote Hands on experience working in GCP services like Big Query, Cloud Storage (GCS), cloud function, cloud dataflow, Pub/sub, Cloud Shell, GSUTIL, Big Query, Data Proc, Operations Suite (Stack driver). Performed in-memory data processing for batch, real-time, and advanced analytics PSRTEK is a reputed technology recruitment and IT staffing brand with a global footprint and an admired client base. As an ideas and innovation powerhouse with a culture of excellence, we bring remarkable expertise and deliver powerfully transformative results.

Title: Lead Data Engineer Location: Cincinnati,OH Duration: 6 Months The Data Engineer will be part of our Debit Modernization workstream joining our one of our Debit squads and assisting with updating how the bank ingests and publishes our Debit product data as part of our larger platform modernization. The individual will be responsible for building mechanisms to receive data from an external partner (file batch and real time events via kafka) and route to our downstream teams for reporting and operational processing. General Function Designs and implements software & support solutions as a member of an agile squad. Software in scope are 3rd party software applications which support finance and regulatory reporting business functions. Technical support functions include ETL, file transfer services, job scheduling, multiple environment support, data quality, upgrades, incident & problem resolution, etc. Being assigned to an agile squad means this role also...

Apex Systems is currently looking for a Data Engineer to help support on of our clients. This will be a full-time, direct placement with the client. They are looking for a resource to support data pipeline creation. The client is currently focused in an Azure Data house, including the use of Data Factory, Data Lake, and Databricks. RESPONSIBILITIES: Primary focus of this role is to architect, develop and maintain data pipelines using analytical, data driven approach for constantly evolving business and that aligns with DFC's long-term technical data strategy Build scalable & repeatable batch & real-time data pipelines using standard frameworks & best practices Collaborate with technical & non-technical teams across organization to craft & build data models/APIs using Scala/Python/Spark on Azure/AWS Catalogue end-to-end data flows Support governance of data usage to ensure consistency, including development of data dictionary and guidance/rules on...

Title: Lead Data Engineer Location: Cincinnati,OH Duration: 6 Months The Data Engineer will be part of our Debit Modernization workstream joining our one of our Debit squads and assisting with updating how the bank ingests and publishes our Debit product data as part of our larger platform modernization. The individual will be responsible for building mechanisms to receive data from an external partner (file batch and real time events via kafka) and route to our downstream teams for reporting and operational processing. General Function Designs and implements software & support solutions as a member of an agile squad. Software in scope are 3rd party software applications which support finance and regulatory reporting business functions. Technical support functions include ETL, file transfer services, job scheduling, multiple environment support, data quality, upgrades, incident & problem resolution, etc. Being assigned to an agile squad means this role also...

Job Description: Design and develop production level search applications for easy searching of content within a big data medical free text data asset. Work with EHR data across teams with ETL, NLP engineers and data scientists, researchers and clinicians to provide searching services with a high data quality control standard. Data Engineer to Build Advanced Search Capability using the Elasticsearch stack Applicant MUST have the following skills: Elasticsearch stack knowledge (demonstrable experience in building search capability tooling using Elasticsearch). Python programming knowledge and experience. Apache Spark, in particular with PySpark API, knowledge and experience. Data pipeline experience. Excellent communication skills. Candidate would be part of a small core NLP Team with 15 core team members (data scientists, project manager, medical informaticists, data analysts) with...

Apex Systems is currently looking for a Data Engineer to help support on of our clients. This will be a full-time, direct placement with the client. They are looking for a resource to support data pipeline creation. The client is currently focused in an Azure Data house, including the use of Data Factory, Data Lake, and Databricks. RESPONSIBILITIES: Primary focus of this role is to architect, develop and maintain data pipelines using analytical, data driven approach for constantly evolving business and that aligns with DFC's long-term technical data strategy Build scalable & repeatable batch & real-time data pipelines using standard frameworks & best practices Collaborate with technical & non-technical teams across organization to craft & build data models/APIs using Scala/Python/Spark on Azure/AWS Catalogue end-to-end data flows Support governance of data usage to ensure consistency, including development of data dictionary and guidance/rules on...

Thanks for your interest. Please apply for further information. Term-Full Time Location--Customer is in Denver area--This is a mainly remote role for those close to the Denver area $-Salary is open for this position and depends on experience, with base salaries ranging from $85, 000 to $140, 000 per year + potential for bonus. Vertical--Services. Open to mid to approaching senior/stand alone resource Please note that this role is open to remote candidates provided that they lives relatively close to Denver CO to include neighboring states. Customer needs team members that excel when working directly with clients to meet their goals. They understand the client s needs and requirements and build a collaborative environment to ensure a successful project delivery. Data Engineers analyze and develop on-premises and/or cloud data and ETL solutions to solve the client s challenges. They enjoy the challenges of consulting and thrive to knock the socks off of clients...

Job Description: Within this role, candidates would be a hands-on leader in data engineering functions including schema design, data movement, data transformation, encryption, and monitoring: all the activities needed to build, sustain and govern big data pipelines. Responsibilities: Own development of large-scale data platform including operational data store, real time metrics store and attribution platform, data warehouses and data marts for advertising planning, operation, reporting and optimization. Wider team collaboration and system documentation. Maintain next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability. Advocate the best engineering practices, including the use of design patterns, CI/CD, code review and automated integration testing. Required Education, Experience, Skills and Training: Bachelor or above in computer...

Job Description: Responsibilities: Evaluates systems specifications regarding customer requirements, transforming specifications into technically correct solutions Competent in TDM functions like data masking, data provisioning, sub setting, profiling, data mining, data handling, data management and synthetic data creation, APIs, Macros Interacts with customers to achieve efficient, effective results by determining data delivery solution Prioritizes work and manages projects within established budget objectives and customer priorities Responsible for establishing and managing quality control and security protocols for test data Provides the division, department and business area with timely and accurate information regarding the status and performance of the assigned data deliverables Leverages technology to develop, redesign and/or implement optimal technology solutions. Builds,...

Job Description: Pay Range $54hr - $59hr Experience working on Snowflake. Experience working on Informatica Cloud (IICS). Experience working on AWS data environment S3, EMR, Lambda, SQS etc. Strong background in developing technical solutions for Cloud data warehouses and data lakes. Exposure to Python is a plus. Experience designing and troubleshooting complicated data extraction routines and real time / batch integrations. Experience extracting and processing data from multiple data sources such as: Databases (Exadata, Oracle, Snowflake), Applications, Web Services (SOAP/REST), flat files (*.csv, *.txt, *.xml, *.json) and streaming data. Experience on Migration of Data Warehouse from on premises to cloud(Snowflake preferred). Exposure to version control (GitLab, GitHub, BitBucket) and CI/CD (Bamboo) tools and methodologies. Experience writing and...

Job Title: Kafka Solutions Specialist Job Description: As a Kafka Solutions Specialist, you will utilize your deep subject matter expertise in Kafka and associated technologies to serve as a critical resource in identifying and addressing high-priority needs of internal and external customers and stakeholders. This role requires a self-directed and detail-oriented individual who excels at problem-solving and has a passion for staying updated on industry trends and best practices. Key Duties and Responsibilities: Subject Matter Expertise: Leverage your extensive knowledge of Kafka, Java, Microservices, and Springboot to assist internal and external clients in meeting their needs while considering cultural and diversity implications. Implementation Planning: Collaborate with other accountable parties to jointly develop practical implementation plans that align with business objectives. Technical Proficiency: Proactively maintain technical knowledge in specialized areas,...

Work Location Options: 100% telecommute Minneapolis onsite San Francisco onsite Hours: 9am-5pm weekdays, with flexibility occasionally required to accommodate timezone differences Interview Process: 2 rounds via video 1 screening interview 1 multi-part interview with team members Description The Data Scientist has education and professional experience in statistics and machine learning. They are experienced with Python and SQL, and have familiarity with Spark, R, and Git, and they will apply software-development best practices to their code, and help others apply them as well. Familiarity with Databricks and/or Ascend, medical claims data, Agile methodologies, and cutting-edge use of LLM's are each preferred as well. This Data Scientist conducts the entire lifecycle of machine learning projects, including creating proposals, determining requirements, defining model targets, creating and evaluating candidate models, and productionizing models and the pipelines...

Work Location Options: 100% telecommute Minneapolis onsite San Francisco onsite Hours: 9am-5pm weekdays, with flexibility occasionally required to accommodate timezone differences Interview Process: 2 rounds via video 1 screening interview 1 multi-part interview with team members Description The Data Scientist has education and professional experience in statistics and machine learning. They are experienced with Python and SQL, and have familiarity with Spark, R, and Git, and they will apply software-development best practices to their code, and help others apply them as well. Familiarity with Databricks and/or Ascend, medical claims data, Agile methodologies, and cutting-edge use of LLM's are each preferred as well. This Data Scientist conducts the entire lifecycle of machine learning projects, including creating proposals, determining requirements, defining model targets, creating and evaluating candidate models, and productionizing models and the pipelines...

Job Title: Application Development Engineer Location: Albany, New York (Try for locals or nearby) - Remote Job Duration: 12 Months+ Visa: Only Greencard or US Citizens can apply Qualifications: 15+ years of IT Administrator experience for large, complex technical and/or data project implementation 10+ years mandatory experience in MAPPER/BIS programming and databases 10+ years mandatory experience in MAPPER/BIS Mainframe maintenance and administration 10+ years mandatory experience in Windows server maintenance and administration 5+ years experience in MAPPER coordination 5+ years experience in DEMAND environment and ECL programming 6+ years experience in MAPPER/BIS CoolICE 8+ MAPPER/BIS GUI UI/UX expertise 6+ years experience working with Microsoft .NET technologies (C#, ASP.NET, MVC, Web API, WCF Services, Windows Services, Asynchronous/ Multithreaded Programming); web development experience with MS SQL, AJAX, HTML 5, CSS, and JavaScript along...

Robinson Group has been retained to fill a newly created position for an expanding chemical manufacturer - the position is a Process Engineer *This company is a leader in their industry and this is an opportunity to "own" and grow process engineering for an entire plant. *HYBRID REMOTE - travel up to 50% to Nevada and then work from home the balance of time. *If relocation is a better option for you, relocation will be provided. *Visa transfer is also offered. *Competitive base salary, bonus and great benefits. ** Process Engineer will provide engineering and technical support by monitoring, controlling, and evaluating the operational performance of production plants in the chemical industry. She/he will work to optimize all production processes to improve performance and quality, reduce cost, and support process implementations. She/he will also use safe, data driven solutions to help achieve the businesses objectives and provide...

Blockchain Engineers Location: 26th Street and Madison Ave NYC NY Duration: 1yr + (Renewable Contracts). Start: ASAP NOTE: This position can become remote / hybrid work after 1 months on Site. Skills Needed Must have 8+ years of experience designing software systems as a senior software developer. Must have 6 + years of experience in the IT Industry as a Java developer / Engineer Must have 4+ years of experience working in the US for US companies. Must have 4+ years of recent experience (With in last 5 years) working in a major US Bank or Brokerage environment. Must have 3+ years of experience building and releasing production grade Block Chain contracts utilizing Solidity, Clarity, and Rust. Must have 2 plus years of experience with blockchain architecture, private keys, and standards/protocols work. Experience with Cryptocurrency /Defi/ Blockchains. Must have strong experience with Blockchain data, creating messanger applications,...

Service Engineer 4 6 Months Contract Tarrytown, NY 10591 Description Completes broad scope of technical tasks including installation/commissioning, maintenance and evaluation of customers equipment and systems among others (after PM100). Determines priorities of tasks and actions and schedules measures accordingly. Supports customer remotely and onsite, and provides 2nd and 3rd level user support in case of arising issues. Contributes to or conducts the maintenance and improvement of internal tools, equipment, processes, and data repositories. Contributes to or executes activities for estimation, planning, and review of technical tasks in support of overall project acquisition, negotiation, planning and management (partly before PM100). Adheres to relevant processes and regulations. May manage sub-contractors and monitors delivery. May be involved in technical design and developments for service offerings. Impacts: Is expected to adopt existing concepts,...