94 Empregos para Pipelines de dados - Belo Horizonte

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

5 months ago Be among the first 25 applicants

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

Get AI-powered advice on this job and more exclusive features.

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Big Data Engineer at BairesDev

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You’ll Do

• Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience.
• Impact the core of business by improving existing architecture or creating new ones.
• Create scalable and high-availability solutions, and contribute to the key differential of each client.
  
  

• 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
• 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
• Proficient in analysis, troubleshooting, and problem-solving.
• Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
• Advanced English level.
  
  

• Building Data Lakes with Lambda/Kappa/Delta architecture.
• DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
• Hands-on experience with managing data loads and data quality.
• Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
• Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
• Performing real-time data visualization and time series analysis using open-source and commercial solutions.
  
  

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BairesDev by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

6 months ago Be among the first 25 applicants

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Big Data Engineer at BairesDev

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You’ll Do

• Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience.
• Impact the core of business by improving existing architecture or creating new ones.
• Create scalable and high-availability solutions, and contribute to the key differential of each client.
  
  

• 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
• 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
• Proficient in analysis, troubleshooting, and problem-solving.
• Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
• Advanced English level.
  
  

• Building Data Lakes with Lambda/Kappa/Delta architecture.
• DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
• Hands-on experience with managing data loads and data quality.
• Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
• Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
• Performing real-time data visualization and time series analysis using open-source and commercial solutions.
  
  

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BairesDev by 2x

Get notified about new Big Data Developer jobs in Brazil .

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

5 months ago Be among the first 25 applicants

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Big Data Engineer at BairesDev

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You’ll Do

• Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience.
• Impact the core of business by improving existing architecture or creating new ones.
• Create scalable and high-availability solutions, and contribute to the key differential of each client.
  
  

• 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
• 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
• Proficient in analysis, troubleshooting, and problem-solving.
• Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
• Advanced English level.
  
  

• Building Data Lakes with Lambda/Kappa/Delta architecture.
• DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
• Hands-on experience with managing data loads and data quality.
• Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
• Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
• Performing real-time data visualization and time series analysis using open-source and commercial solutions.
  
  

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BairesDev by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

5 months ago Be among the first 25 applicants

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

Get AI-powered advice on this job and more exclusive features.

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Big Data Engineer at BairesDev

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You’ll Do

• Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience.
• Impact the core of business by improving existing architecture or creating new ones.
• Create scalable and high-availability solutions, and contribute to the key differential of each client.
  
  

• 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
• 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
• Proficient in analysis, troubleshooting, and problem-solving.
• Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
• Advanced English level.
  
  

• Building Data Lakes with Lambda/Kappa/Delta architecture.
• DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
• Hands-on experience with managing data loads and data quality.
• Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
• Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
• Performing real-time data visualization and time series analysis using open-source and commercial solutions.
  
  

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BairesDev by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

5 months ago Be among the first 25 applicants

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Big Data Engineer at BairesDev

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You’ll Do

• Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience.
• Impact the core of business by improving existing architecture or creating new ones.
• Create scalable and high-availability solutions, and contribute to the key differential of each client.
  
  

• 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
• 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
• Proficient in analysis, troubleshooting, and problem-solving.
• Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
• Advanced English level.
  
  

• Building Data Lakes with Lambda/Kappa/Delta architecture.
• DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
• Hands-on experience with managing data loads and data quality.
• Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
• Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
• Performing real-time data visualization and time series analysis using open-source and commercial solutions.
  
  

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BairesDev by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

RELEVO LAB. Somos uma empresa de tecnologia com mais de 6 anos de atuação, vivemos e respiramos tecnologia, batalhamos incansavelmente para ser um lugar incrível para se trabalhar, onde as pessoas são tratadas com igualdade, gostem de trabalhar, se sintam em casa e esse é certamente o lugar onde queremos estar.

RELEVO LAB. Somos uma empresa de tecnologia com mais de 6 anos de atuação, vivemos e respiramos tecnologia, batalhamos incansavelmente para ser um lugar incrível para se trabalhar, onde as pessoas são tratadas com igualdade, gostem de trabalhar, se sintam em casa e esse é certamente o lugar onde queremos estar.

Estamos à procura de pessoas do bem, comprometidas e que queiram crescer junto com a gente! Se você se enquadra neste perfil, é você que queremos!

Gerenciar e desenvolver conteúdo para ofertas, apoiar o desenvolvimento e capacitação do cliente, participar de discussões em equipe, fornecer soluções para problemas, colaborar com equipes multifuncionais, conduzir sessões de treinamento, analisar feedback dos clientes e desenvolver soluções inovadoras alinhadas às necessidades do cliente.

Jornada de trabalho: Segunda a Sexta, das 9h às 18h (1h de intervalo para almoço)

Tipo de Vaga: Home Office

Contratação: CLT

Tempo de alocação: 8 meses com possibilidade de extensão

O que queremos que você tenha:

• Gerenciamento de Banco de Dados de Configuração
• Gerenciamento de CI
• Design e Desenvolvimento de Relatórios
• Microsoft Azure Apache Spark
• Python
• Desenvolvimento de Software .NET

O que oferecemos: Pacote de remuneração e benefícios competitivo com o mercado.

Gostou? Acesse nossa página de carreira em

Super Importante! Se os seus conhecimentos forem aderentes à vaga, é tudo o que importa.

Aqui nós abraçamos a diversidade e contratamos pessoas com capacidade e vontade de transformar, independente de qual seja a sua localização, raça, cor, religião, identidade de gênero, orientação sexual ou formação.

São Paulo, São Paulo, Brazil 6 months ago

RELEVO LAB.

Somos uma empresa de tecnologia com mais de 6 anos de atuação, vivemos e respiramos tecnologia, batalhamos incansavelmente para ser um lugar incrível para se trabalhar, onde as pessoas são tratadas com igualdade, gostem de trabalhar, se sintam em casa e esse é certamente o lugar onde queremos estar.

Estamos à procura de pessoas do bem,comprometidas e que queiram crescer junto com a gente!

Se você se enquadra neste perfil, é você que queremos!

Gerenciar e desenvolver conteúdo para ofertas, apoiar o desenvolvimento e capacitação do cliente, participar de discussões em equipe, fornecer soluções para problemas, colaborar com equipes multifuncionais, conduzir sessões de treinamento, analisar feedback dos clientes e desenvolver soluções inovadoras alinhadas às necessidades do cliente.

Jornada de trabalho: Segunda a Sexta, das 9h às 18h (1h de intervalo para almoço)

Tipo de Vaga: Home Office

Contratação: CLT

Tempo de alocação: 8 meses com possibilidade de extensão

O que queremos que você tenha:

• Gerenciamento de Banco de Dados de Configuração
• Gerenciamento de CI
• Design e Desenvolvimento de Relatórios
• Microsoft Azure Apache Spark
• Python
• Desenvolvimento de Software .NET

O que oferecemos:

Pacote de remuneração e benefícios competitivo com o mercado.

Gostou? Acessenossa página de carreira em

Super Importante!

Se os seus conhecimentos forem aderentes à vaga, é tudo o que importa.

Aqui nós abraçamos a diversidade e contratamos pessoas com capacidade e vontade de transformar, independente de qual seja a sua localização, raça, cor, religião, identidade de gênero, orientação sexual ou formação.

Descrição: Big Data Engineer

Our Client is a US technology company looking for a highly motivated Data Engineer with a passion for data, to build and implement data pipelines in cloud technologies, including SnapLogic and AWS.

Responsibilities:
● Develops and maintains scalable data pipelines in SnapLogic and builds out new ETL and API integrations to support continuing increases in data volume and complexity.
● Develop and maintain data models for core package application and reporting databases to describe objects and fields for support documentation and to facilitate custom application development and data integration.
● Monitoring execution and performance of daily pipelines, triage and escalate any issues.
● Collaborates with analytics and business teams to improve data models and data pipelines that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization.
● Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes.
● Writes unit/integration tests, contributes to engineering wiki, and documents work.
● Performs data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
● Work within AWS/Linux cloud systems environment in support of data integration solution
● Works closely with a team of frontend and backend engineers, product managers, and analysts.
● Teamwork: Collaborate with team members. Share knowledge, provide visibility into personal accomplishments and follow directions when provided.

Experience Required or equivalent
● Experience with SnapLogic including writing pipelines that include mappers, gates, logging, bulk loads, and Salesforce SOQL queries;
● Experience with AWS services including but not limited to S3, Athena, EC2, EMR, Glue;
● Ability to solve any ongoing issues with operating the cluster;
● Experience with integration of data from multiple data sources;
● Experience with various database technologies such as SQLServer, Redshift, Postgres, RDS;
● Experience with one or more of the following data integration platforms: Pentaho Kettle, SnapLogic, Talend OpenStudio, Jitterbit, Informatica PowerCenter, or similar;
● Knowledge of best practices and IT operations in an always-up, always-available service;
● Experience with or knowledge of Agile Software Development methodologies;
● Excellent problem solving and troubleshooting skills;
● Excellent oral and written communication skills with a keen sense of customer service;
● Experience with collecting/managing/reporting on large data stores;
● Awareness of Data governance and data quality principles;
● Well versed in Business Analytics including basic metric building and troubleshooting;
● Understand Integration architecture: application integration and data flow diagrams, source-to-target mappings, data dictionary reports;
● Familiar with Web Services: XML, REST, SOAP;
● Experience with Git or similar version control software;
● Experience with integrations with and/or use of BI tools such as GoodData (Prefered), Tableau, PowerBI, or similar;

Database experience:
● Broad experience multiple RDBMS: MS SQLServer, Oracle, MySQL, PostgreSQL, Redshift;
● Familiarity with SaaS/cloud data systems (e.g. Salesforce);
● Data warehouse design: star-schemas, change data capture, denormalization;
● SQL/DDL queries/Tuning techniques such as indexing, sorting, distribution;

Education, Experience, and Licensing Requirements:
● BS or MS degree in Computer Science or a related technical field;
● 3+ years of Data Pipeline development such as SnapLogic (preferred) or Datastage,Informatica or related experience;
● 3+ years of SQL experience (No-SQL experience is a plus);
● Experience designing, building, and maintaining data pipelines;

Where: home -office
Salary: in US$
Re

Descrição: Big Data Engineer

Our Client is a US technology company looking for a highly motivated Data Engineer with a passion for data, to build and implement data pipelines in cloud technologies, including SnapLogic and AWS.

Responsibilities:
● Develops and maintains scalable data pipelines in SnapLogic and builds out new ETL and API integrations to support continuing increases in data volume and complexity.
● Develop and maintain data models for core package application and reporting databases to describe objects and fields for support documentation and to facilitate custom application development and data integration.
● Monitoring execution and performance of daily pipelines, triage and escalate any issues.
● Collaborates with analytics and business teams to improve data models and data pipelines that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization.
● Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes.
● Writes unit/integration tests, contributes to engineering wiki, and documents work.
● Performs data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
● Work within AWS/Linux cloud systems environment in support of data integration solution
● Works closely with a team of frontend and backend engineers, product managers, and analysts.
● Teamwork: Collaborate with team members. Share knowledge, provide visibility into personal accomplishments and follow directions when provided.

Experience Required or equivalent
● Experience with SnapLogic including writing pipelines that include mappers, gates, logging, bulk loads, and Salesforce SOQL queries;
● Experience with AWS services including but not limited to S3, Athena, EC2, EMR, Glue;
● Ability to solve any ongoing issues with operating the cluster;
● Experience with integration of data from multiple data sources;
● Experience with various database technologies such as SQLServer, Redshift, Postgres, RDS;
● Experience with one or more of the following data integration platforms: Pentaho Kettle, SnapLogic, Talend OpenStudio, Jitterbit, Informatica PowerCenter, or similar;
● Knowledge of best practices and IT operations in an always-up, always-available service;
● Experience with or knowledge of Agile Software Development methodologies;
● Excellent problem solving and troubleshooting skills;
● Excellent oral and written communication skills with a keen sense of customer service;
● Experience with collecting/managing/reporting on large data stores;
● Awareness of Data governance and data quality principles;
● Well versed in Business Analytics including basic metric building and troubleshooting;
● Understand Integration architecture: application integration and data flow diagrams, source-to-target mappings, data dictionary reports;
● Familiar with Web Services: XML, REST, SOAP;
● Experience with Git or similar version control software;
● Experience with integrations with and/or use of BI tools such as GoodData (Prefered), Tableau, PowerBI, or similar;

Database experience:
● Broad experience multiple RDBMS: MS SQLServer, Oracle, MySQL, PostgreSQL, Redshift;
● Familiarity with SaaS/cloud data systems (e.g. Salesforce);
● Data warehouse design: star-schemas, change data capture, denormalization;
● SQL/DDL queries/Tuning techniques such as indexing, sorting, distribution;

Education, Experience, and Licensing Requirements:
● BS or MS degree in Computer Science or a related technical field;
● 3+ years of Data Pipeline development such as SnapLogic (preferred) or Datastage,Informatica or related experience;
● 3+ years of SQL experience (No-SQL experience is a plus);
● Experience designing, building, and maintaining data pipelines;

Where: home -office
Salary: in US$
Re