C6 Bank
Dell Technologies
Senior Principal Observability Engineer
About the opportunity
Senior Principal Observability Engineer
Be part of a team that ensures product integrity and customer satisfaction for Dell Technologies. Our IT Software Engineering team transforms business requirements into technology solutions through the design, development, testing, and debugging of applications, as well as documenting usage procedures and continuously seeking quality improvements.
Join us as a Senior Principal Observability Engineer on the Software Engineering team in Eldorado do Sul/RS to do the best work of your career and make a significant social impact.
Take the first step toward your dream career
Every member of Dell Technologies brings something unique to the team. Here’s what we’re looking for in this role:
What you will achieve
As a Senior Principal Observability Engineer, you will be responsible for implementing, deploying, and optimizing enterprise observability solutions that provide end-to-end visibility across distributed systems, applications, and infrastructure. You will partner with engineering, platform, operations, and cloud teams to deliver scalable observability platforms, establish telemetry standards, and ensure reliable monitoring and operational excellence across the organization.
You will:
- Deploy, configure, maintain, and optimize observability platforms encompassing metrics, logs, distributed tracing, and events in production environments, including troubleshooting performance issues and optimizing platform resource utilization.
- Implement observability standards and telemetry solutions across the organization, including OpenTelemetry instrumentation, collector configuration, SDKs integration, semantic conventions, and development of telemetry data pipelines for reliable collection and routing.
- Monitor telemetry data ingestion and storage, implement sampling and retention strategies to balance visibility and operational costs, and automate instrumentation, configuration, and agent deployment through Infrastructure as Code (IaC) practices and CI/CD pipelines.
- Investigate and resolve complex production issues related to observability platforms and telemetry pipelines, and integrate observability solutions with enterprise systems, identity providers, and existing monitoring workflows.
- Implement observability capabilities for Large Language Models (LLMs)-based applications, including model performance monitoring, prompt evaluation metrics, token consumption tracking, inference latency measurement, and execution of observability patterns and best practices across the organization.
Essential Requirements
- Advanced/fluent English
- Advanced experience in Site Reliability Engineering (SRE), DevOps, Cloud Infrastructure, or Software Engineering, with a strong focus on implementing observability and telemetry.
- Hands-on experience deploying, operating, and supporting modern observability platforms such as Dynatrace, Splunk, Grafana, Datadog, and Elastic/ELK, as well as telemetry pipeline technologies including Fluent Bit, Vector, and Cribl.
- Proficiency in Infrastructure as Code (IaC) tools like Terraform, Ansible, or Helm, including automated provisioning and configuration management.
- In-depth experience implementing OpenTelemetry instrumentation, collectors, and semantic conventions in production environments.
- Strong analytical and troubleshooting skills to diagnose complex distributed systems and telemetry pipelines.
Preferred Requirements
- Knowledge of native AI observability strategies in production environments, including platforms like Langfuse, LangSmith, and Arize.
- Completed bachelor's degree
Who We Are
We believe that each of us has the power to make an impact. That’s why we put our team members at the center of everything we do. If you’re looking for an opportunity to grow your career with some of the best minds and most advanced tech in the industry, we’re looking for you.
Dell Technologies is a unique family of businesses that helps individuals and organizations transform how they work, live and play. Join us to build a future that works for everyone because Progress Takes All of Us.
Dell Technologies is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. Read the full Equal Employment Opportunity Policy iawmqy.fa.ocs.oraclecloud.com/hcmUI/CandidateExperience/en/sites/careers/pages/equal-employment-opportunity-policy-statement. Visit our Culture Code jobs.dell.com/en/how-we-work-and-lead page to learn more about how we work and lead.
