531 big data engineer jobs found

You'll be joining our FX Trade Advanced Analytics team as a Senior Software Engineer. We're responsible for building and delivering complex Big Data analytic applications across our regulated FX trading venues. Advanced Analytics team provides traders with the ability to assess historical trading data with comparisons of liquidity providers and data visualization technology. Our existing analytic capability processes millions of FX trade messages every day through our Hadoop big data stack (including Scala, Spark, HDFS, HBase and Hive). Advanced Analytics team help users gain a better understanding of the transaction costs they incur during the normal course of their daily trading and enable them to have more meaningful conversations about pricing with their liquidity providers. Responsibilities You will be responsible for the design and implementation of new analytic application capabilities inside our overall Big Data ecosystem. As such, you will need strong technical...

S&P Global Ratings Job Title:  Sr. Big Data Engineer Location:  NY, New York The Grade : 12 Job Description: S&P Global Ratings is looking for an experienced Big Data Engineer to join Data Engineering team within Chief Data Office, a team of data and technology professionals who define and execute the strategic data roadmap for S&P Global Ratings. The successful candidate will participate in the design and build of S&P Ratings cloud based analytics platform to help develop and deploy advanced analytics/machine learning solutions. Responsibilities:                                           Design and develop efficient and scalable data pipelines between enterprise systems and analytics platform Work closely with Data Science team and participate in development of feature engineering pipelines Provide technical expertise in the areas of design and implementation of Ratings Integrated Data Facility with modern AWS cloud technologies...

Job Title Big Data Engineer Job Purpose Data Engineer What does a successful Data Engineer do at Fiserv? As an experienced Data Engineer, you will be part of the Data Engineering Platform Group. You will take ownership and build the design and development of projects within Fiserv’s Enterprise Data Analytics division. What you will do: - Work with product owners and source teams to understand the datasets, process flows and build systems to ingest variety of data to DataHub efficiently. - Develop configuration driven enterprise level batch process to ingest daily batch data and utilized it for ingest TBs of complex type history data. - Develop enterprise level Spark based Kafka streaming consumer application to consume more than 7000TPS - You will Lead large-scale projects, build custom integrations between cloud-based systems using APIs and write complex and efficient queries to transform raw data sources into easily accessible models by coding...

Job Title Big Data Engineer, Senior Job Purpose What does a successful Big Data Engineer, Senior do? As an experienced member of our Data Engineering Platform Group you will be responsible for building and taking ownership over the successful design and development of data engineering projects within Fiserv’s Enterprise Data Analytics division. You will be apply your depth of knowledge and expertise to all aspects of the data engineering lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals. What you will do You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally. You will Lead large-scale data engineering, integration and warehousing projects, build custom integrations between cloud-based systems using APIs and write complex and efficient queries to...

You'll be joining our FX Trade Advanced Analytics team as a Senior Software Engineer. We're responsible for building and delivering complex Big Data analytic applications across our regulated FX trading venues. Advanced Analytics team provides traders with the ability to assess historical trading data with comparisons of liquidity providers and data visualization technology. Our existing analytic capability processes millions of FX trade messages every day through our Hadoop big data stack (including Scala, Spark, HDFS, HBase and Hive). Advanced Analytics team help users gain a better understanding of the transaction costs they incur during the normal course of their daily trading and enable them to have more meaningful conversations about pricing with their liquidity providers. Responsibilities You will be responsible for the design and implementation of new analytic application capabilities inside our overall Big Data ecosystem. As such, you will need strong technical...

Binance is the global blockchain company behind the world’s largest digital asset exchange by trading volume and users, serving a greater mission to accelerate cryptocurrency adoption and increase the freedom of money. Are you looking to be a part of the most influential company in the blockchain industry and contribute to the crypto-currency revolution that is changing the world? We are looking for a seasoned Data Engineer to join the team. We are continuing to build up our next generation crypto-currency exchange and are looking for eager, hard-working problem solvers that can continue to evolve our 24-7, highly scalable, exchange system as new features and performance improvements are constantly being added.   Responsibilities: Responsible for design, development and optimization of our internal data portal Responsible for requirement analysis with product management, and providing technical solution Responsible for iterative development, deployment of...

Binance is the global blockchain company behind the world’s largest digital asset exchange by trading volume and users, serving a greater mission to accelerate cryptocurrency adoption and increase the freedom of money. Are you looking to be a part of the most influential company in the blockchain industry and contribute to the crypto-currency revolution that is changing the world? We are looking for a seasoned SRE Engineer to design and improve our central Big Data infrastructure/services to the next stage, to ensure the data, services, and infrastructures are reliable, fault-tolerant, efficiently scalable, and cost-effective   Responsibilities Engage in and improve the whole lifecycle of service, from inception and design, through to deployment, operation, and refinement. Develop and maintain tools, re-designing capacity planning infrastructure for greater scalability. Troubleshooting, diagnosing, fixing software issues, and ensuring data security. Define...

Binance is the global blockchain company behind the world’s largest digital asset exchange by trading volume and users, serving a greater mission to accelerate cryptocurrency adoption and increase the freedom of money. Are you looking to be a part of the most influential company in the blockchain industry and contribute to the crypto-currency revolution that is changing the world? About Binance Accelerator Programme  Binance Accelerator Programme is a concise 3 - 6 months programme designed to have an immersive experience in the rapidly expanding Web3 space.  You will be given the opportunity to experience life at Binance and understand what goes on behind the scenes of the world’s leading blockchain ecosystem. Alongside your job, there will also be a focus on networking and development, which will expand your professional network and build transferable skills to propel you forward in your career. Our Binance Accelerator Programme starts the first Monday of every month...

Binance is the global blockchain company behind the world’s largest digital asset exchange by trading volume and users, serving a greater mission to accelerate cryptocurrency adoption and increase the freedom of money. Are you looking to be a part of the most influential company in the blockchain industry and contribute to the crypto-currency revolution that is changing the world?   Responsibilities Work closely with team members (developers, product manager, and other partners) to develop, test and deliver high quality data application products Create detailed, comprehensive and well-structured test plans and test cases Prevent, report, analyze and track issues in an effective and efficient manner Work closely with team members to design the effective and efficient test strategy and execute for testing big data platform/pipeline/applications Improve test strategy to reduce manual test efforts. Design, develop and execute automation scripts   Requirements...

Job Summary                 As an Infrastructure Service Manager within Foundation Services, the candidate is required to have a sound understanding of the ITSM methodology. The candidate should understand the lifecycle of the entire ITSM process including Incident, Change, Problem, and Configuration. Well-developed Communication and interpersonal skills are critical to this role. There will be a reactive focus on Recovery Management during major issues and supporting the RCA process. The Service Manager champions a culture of continuous service improvement using the policies as a framework and reporting on our service performance to guide service and risk priorities and actions. Responsibilities Proactive Service Management of the technology services provided by the Foundation area of Infrastructure & Cloud including Data Centers, Platform (server), Storage, Private Cloud, Database, Big Data and Middleware. Bring in best ITSM practices to evaluate and update...

Role Profile Role Description: This role will be a part of the Finance Center of Excellence and support senior management with various financial aspects of LSEG’s Operation. The successful candidate will combine excellent commercial, communication and technical skills to provide financial insight for business partnering, reporting, planning, and forecasting. Key responsibilities of the role: The role will include but not limited to the following: Business Partner to leaders within the Divisions/ Functions of LSEG, providing commercial insight, analysis, and decision support to senior management Lead on consolidation and integration of financial reporting as the integration of LSEG and Refinitiv continues Responsible for providing financial insight and analysis, also supporting other business lines as necessary Provide support as needed on cross-Operations projects Lead/ Support monthly reporting and consolidation of financial performance and annual budget...

We are seeking a Fullstack Software Engineer with experience in AWS Cloud, Terraform, Python or Javascript to join our team. The ideal candidate will have a track record of creating scalable software solutions, using best practice approaches while working both alone and collaboratively within a team. As a Fullstack Engineer, you will be responsible for contributing towards the design and development of complex software systems, collaborating with cross-functional teams to define, design, and ship new features. You will assist with providing technical guidance and participate in the full software development life cycle, including requirements gathering, design, development, testing, and deployment. If you are passionate about staying up to date with industry trends and incorporating new technologies and approaches into your work, we encourage you to apply. Strong communication and critical thinking skills are a must for this role. Join our team and help us build innovative...

Job Summary As an Infrastructure Service Manager within Foundation Services, the candidate is required to have a sound understanding of the ITSM methodology. The candidate should understand the lifecycle of the entire ITSM process including Incident, Change, Problem, and Configuration. Well-developed Communication and interpersonal skills are critical to this role. There will be a reactive focus on Recovery Management during major issues and supporting the RCA process. The Service Manager champions a culture of continuous service improvement using the policies as a framework and reporting on our service performance to guide service and risk priorities and actions. Responsibilities: Proactive Service Management of the technology services provided by the Foundation area of Infrastructure & Cloud including Data Centers, Platform (server), Storage, Private Cloud, Database, Big Data and Middleware. Bring in best ITSM practices to evaluate and update existing...

LSEG Technology brings together our product development, operations, digital and business technology, cyber security, architecture, and technology program management groups. The Technology Finance Team is responsible for delivering service excellence across the Technology functions, with ongoing management of the business relationship across both senior Finance & Technology stakeholders. LSEG is embarking on several strategic transformational programmes which will shape the future of the organisation.   This is a Manager role, partnering directly with the Director of Technology and Finance and the broader teams to support the delivery of the transformation.  The role carries focuses on Technology programs and is expected to own relationships end-to-end, acting independently as the coordinator of the Group-wide programs interfacing with the Technology Finance team. The successful candidate should have proven ability to work in a dynamic, fast paced environment. Key...

We are seeking a Lead Software Engineer with strong experience in AWS Cloud, Terraform, Python or Javascript to join our team. The ideal candidate will have a track record of successfully leading small teams of skilled software engineers and be comfortable guiding and motivating team members to achieve project goals. As a Lead Software Engineer, you will be responsible for leading the design and development of complex software systems, collaborating with cross-functional teams to define, design, and ship new features, and ensuring the quality and performance of the team's work through code reviews and testing. You will also have the opportunity to mentor and provide technical guidance to team members and participate in the full software development life cycle, including requirements gathering, design, development, testing, and deployment. If you are passionate about staying up to date with industry trends and incorporating new technologies and approaches into your work, we...

AlphaDesk is LSEG’s Order and Portfolio Management Software, which develops and supports the software for hedge funds and asset managers globally. We are a diverse team with good technical skills, and the quality of our software and client services is at the core of our business. The Client Services team within AlphaDesk assists our clients in using our software to handle their trading, monitoring, and reporting of their investments. The team works directly with portfolio managers, traders, and operations staff at hedge funds to resolve issues and explain AlphaDesk’s capabilities. We regularly hear from clients that our support is industry leading. We are seeking a candidate who can grow and improve our reputation for high quality support while managing our regional team in EMEA.  The ideal candidate will leverage both management and technical skills.  You will be responsible for empowering and mentoring a team of product consultants to resolve all client issues.  You will...

Data Platform – Sr Development lead   LSEG  and Microsoft have entered an exciting strategic partnership for the development of next-generation data, analytics and cloud infrastructure solutions. Our customers’ needs are evolving and so are financial markets. This partnership will transform the way customers discover, analyse and trade securities around the world. It will also advance our cloud strategy and build the improved resilience, efficiency and agility that our customers need. All of Microsoft’s customers will also have access to our data and analytics capabilities through a single flexible infrastructure that is intuitive and responsive.   If you are interested in being a part of this dynamic strategic partnership,  we look forward to considering your skills and experience. ABOUT US: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to...

Data Platform – Sr Development lead   LSEG  and Microsoft have entered an exciting strategic partnership for the development of next-generation data, analytics and cloud infrastructure solutions. Our customers’ needs are evolving and so are financial markets. This partnership will transform the way customers discover, analyse and trade securities around the world. It will also advance our cloud strategy and build the improved resilience, efficiency and agility that our customers need. All of Microsoft’s customers will also have access to our data and analytics capabilities through a single flexible infrastructure that is intuitive and responsive.   If you are interested in being a part of this dynamic strategic partnership,  we look forward to considering your skills and experience. ABOUT US: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to...

Job Summary As an Infrastructure Service Manager within Foundation Services, the candidate is required to have a sound understanding of the ITSM methodology. The candidate should understand the lifecycle of the entire ITSM process including Incident, Change, Problem, and Configuration. Well-developed Communication and interpersonal skills are critical to this role. There will be a reactive focus on Recovery Management during major issues and supporting the RCA process. The Service Manager champions a culture of continuous service improvement using the policies as a framework and reporting on our service performance to guide service and risk priorities and actions. Responsibilities: Proactive Service Management of the technology services provided by the Foundation area of Infrastructure & Cloud including Data Centres, Platform (server), Storage, Private Cloud, Database, Big Data and Middleware. Bring in best ITSM practices to evaluate and update existing...

Manager (Assistant Manager),  Direct Tax, Finance CoE Role Profile The role is aligned to the Finance Centre of Excellence and reports to the Director, Taxation, Finance CoE. The position will have direct tax responsibility for a portfolio of the group’s entities, delivering corporate tax compliance, local tax reporting, supporting the global tax reporting process, and partnering with the business. The role will work closely with members of the Group Tax team, outsourced tax service providers, the financial controller community and business partners on delivering the goals of the tax function in the region. Key Responsibilities  The selected candidate will have ownership of: Managing direct tax compliance and reporting responsibilities for assigned countries with respect to: tax provisions for local entity financial statements, tax returns, tax payments, and routine informational tax audits These responsibilities are supported by outsourced tax service...

Job Description We are looking for a passionate, collaborative, and skilled Site Reliability Engineer (SRE) to begin work with Capital Markets FX on the London Stock Exchange. As Capital Markets FX continues to expand and grow, we are seeking an experienced SRE to deliver insights and help build out a stable environment. We are looking for someone who demonstrates a unique viewpoint and enjoys collaborating with an active team to develop viable solutions resulting in stability and continuous growth. Responsibilities Engage in and improve the whole lifecycle of services—from inception and design, through deployment, operation and refinement, working closely with developers and operations teams, bridging gaps. Support services before they go live through activities such as system design consulting, developing software platforms and frameworks, capacity planning and launch reviews. Maintain services once they are live by measuring and monitoring availability, latency and...

Responsibilities: Contribute to development of our in-house cross-functional data storage platform Establish a data infrastructure strategy to capture and harness new data assets for the new products and technology practices Collaborate with decision makers, project managers, data scientists, and other stakeholders Build data pipelines using Apache Airflow, Redshift, Spark, Kafka, and more Connect new data sources Maintain data infrastructure (resource management, upgrades) Monitor data pipelines and improve their performance Qualifications You are proficient in writing SQL on analytics (OLAP) databases (preferably Redshift, Clickhouse) You are proficient in writing SQL on transactional (OLTP) databases (preferably PostgreSQL) You are experienced in transforming data model requirements into Big Data solutions You have worked on efficient cloud-based data warehouse/data lake operation You are experienced in tasks automation, preferably in Python You have...

Responsibilities: Contribute to development of our in-house cross-functional data storage platform Establish a data infrastructure strategy to capture and harness new data assets for the new products and technology practices Collaborate with decision makers, project managers, data scientists, and other stakeholders Build data pipelines using Apache Airflow, Redshift, Spark, Kafka, and more Connect new data sources Maintain data infrastructure (resource management, upgrades) Monitor data pipelines and improve their performance Qualifications You are proficient in writing SQL on analytics (OLAP) databases (preferably Redshift, Clickhouse) You are proficient in writing SQL on transactional (OLTP) databases (preferably PostgreSQL) You are experienced in transforming data model requirements into Big Data solutions You have worked on efficient cloud-based data warehouse/data lake operation You are experienced in tasks automation, preferably in Python You have...

Responsibilities: Contribute to development of our in-house cross-functional data storage platform Establish a data infrastructure strategy to capture and harness new data assets for the new products and technology practices Collaborate with decision makers, project managers, data scientists, and other stakeholders Build data pipelines using Apache Airflow, Redshift, Spark, Kafka, and more Connect new data sources Maintain data infrastructure (resource management, upgrades) Monitor data pipelines and improve their performance Qualifications You are proficient in writing SQL on analytics (OLAP) databases (preferably Redshift, Clickhouse) You are proficient in writing SQL on transactional (OLTP) databases (preferably PostgreSQL) You are experienced in transforming data model requirements into Big Data solutions You have worked on efficient cloud-based data warehouse/data lake operation You are experienced in tasks automation, preferably in Python You have...