4 Empregos para Analistas de dados - Jundiaí

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

5 months ago Be among the first 25 applicants

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Big Data Engineer at BairesDev

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You’ll Do

• Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience.
• Impact the core of business by improving existing architecture or creating new ones.
• Create scalable and high-availability solutions, and contribute to the key differential of each client.
  
  

• 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
• 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
• Proficient in analysis, troubleshooting, and problem-solving.
• Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
• Advanced English level.
  
  

• Building Data Lakes with Lambda/Kappa/Delta architecture.
• DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
• Hands-on experience with managing data loads and data quality.
• Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
• Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
• Performing real-time data visualization and time series analysis using open-source and commercial solutions.
  
  

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BairesDev by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

6 months ago Be among the first 25 applicants

Join to apply for the Big Data Engineer - Remote Work | REF# role at BairesDev

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Big Data Engineer at BairesDev

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You’ll Do

• Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience.
• Impact the core of business by improving existing architecture or creating new ones.
• Create scalable and high-availability solutions, and contribute to the key differential of each client.
  
  

• 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
• 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
• Proficient in analysis, troubleshooting, and problem-solving.
• Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
• Advanced English level.
  
  

• Building Data Lakes with Lambda/Kappa/Delta architecture.
• DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
• Hands-on experience with managing data loads and data quality.
• Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
• Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
• Performing real-time data visualization and time series analysis using open-source and commercial solutions.
  
  

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BairesDev by 2x

Get notified about new Big Data Developer jobs in Brazil .

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Workplace: Belo Horizonte - MG Belo Horizonte - MG

Job type: Full-time employee Full-time employee

Nós somos a BHS!

Com 30 anos de experiência no mercado, proporcionamos soluções modernas de TI.

Somos reconhecidos como a MELHOR empresa para se trabalhar em MG e no BRASIL pelo GPTW - Great Place to Work , e estamos classificados entre as cinco melhores empresas para se trabalhar nas categorias LGBTQIA+ e Étnico-Racial , demonstrando nosso compromisso com a diversidade, equidade e inclusão.

O que a gente espera de você?

·Habilidade de relacionamento com pessoas de diferentes áreas e de diversos níveis de hierarquia;

·Colaboração;

·Ser proativo e saber trabalhar fora da zona de conforto;

· Alguém que queira fazer parte de projetos incríveis e tenha muita vontade de aprender, ensinar e crescer junto com a BHS.

Suas atividades serão:

·Realizar a criação/manutenção/sustentação de pipelines de ingestão e transformação de dados(ETL) utilizando scripts SQL (CTEs e Macros), Python(FastAPI, Pyspark)

·Coletar dados para fontes públicas ou privadas disponíveis utilizando tecnologias como Python, Selenium, FastAPI, entregues como API’s encapsuladas em conteiners Docker;

·Criação de scripts de ETL destinados à extração, transformação e carga dos dados de uma ou mais bases de origem para uma ou mais bases de dados de destino, incluindo ambiente de BigData;

· Utilização de ferramentas como Apache NiFi (envio de requisições HTTP, visualização de Logs), Hive(Inserts e consultas para ambiente de Big Data). Versionamento dos scripts utilizando Git.

·Realizar verificações de qualidade dos dados, garantindo a integridade e a precisão dos dados em todos os espectros antes de implementar as descobertas;

·Acessar, manipular, transformar, agrupar e analisar grandes conjuntos de dados estruturados, não estruturados ou semi-estruturados;

· Realizar a extração/carga de dados nas modalidades: batch, incremental e tempo real;

· Gerar a Documentação de toda a atividade desenvolvida.

Buscamos uma pessoa que possua experiências com:

· Experiência na construção de ETL's (Modelagem Relacional e multidimensionais);

· Relacionamento com áreas de negócio da empresa para atendimento das demandas;

· Conhecimento nas tecnologias com Python, FastAP, banco de dados relacionais, Git e Docker;

· Conhecimento em ambiente de BigData;

· Conhecimento no processo de Data Cleaning em grandes conjuntos de dados estruturados, semi-estruturados e não estruturados.

· Experiência com tratativa de dados em ambiente de BigData;

· Experiência nas tecnologias com Apache NiFi, Apache Hive, Kibana (Elastic Search), Zeppelin (Pyspark), Banco de Dados NoSQL.

O que você pode esperar de nós?

Na BHS, cuidamos do seu bem-estar como prioridade número um. Estamos aqui para garantir que sua experiência seja incrível, com todo o suporte que você precisar. Por aqui você vai encontrar:

Plano de saúde e Assistência Odontológica;

Vale Refeição/Alimentação no cartão Flash;

Auxílio Home Office;

Licença Maternidade/Paternidade estendida;

Parcerias e convênios diversos em educação, saúde e lazer (Universidades, escolas de Idioma, academias, clínicas de saúde.);

Cultura de Feedback contínuo, com: Feedbacks semestrais, 1:1, PDI (Plano de Desenvolvimento Individual) e BHS Experience.

Buscamos a inclusão da diversidade no nosso dia a dia e acreditamos que equipes plurais têm melhor desempenho. Todas as pessoas são bem-vindas. Venha ser um B.Techer

Veja nossa avaliação no Glassdoor (4.5 Estrelas e 90% recomendado para outras pessoas).

• Step 2: Bate-papo com gestão de pessoas 2 Bate-papo com gestão de pessoas
• Step 3: Análise da gestão/cliente 3 Análise da gestão/cliente
• Step 4: Bate-papo técnico com a gestão/cliente 4 Bate-papo técnico com a gestão/cliente
• Step 5: Aguardando retorno do cliente/gestor 5 Aguardando retorno do cliente/gestor

30 anos de história: construindo relações com pessoas, inovações e clientes.