StarTree Makes Observability Case for Apache Pinot Database - DevOps.com
StarTree enhances real-time database platform with support for metrics, logs, and traces, offering ThirdEye anomaly detection service and free serverless computing tier. [ more ]
How to observe your Blazor WebAssembly application with OpenTelemetry and real user monitoring
WebAssembly monitoring tools face challenges due to its binary execution environment, demanding specialized solutions for observability without performance impact. [ more ]
Observability in DevOps is evolving beyond monitoring - Amazic
Observability goes beyond traditional monitoring by understanding system behavior and providing a comprehensive view of system health.
Observability tools help map complex systems, facilitate team collaboration, and integrate automation and AI for proactive performance optimization. [ more ]
Observability goes beyond traditional metrics monitoring and collects various types of data to understand the overall state of the production environment.
Observability helps identify unknown unknowns and can help reduce infrastructure costs. [ more ]
Mezmo Adds Free Community Plan for Managing Observability Data
By: Mike Vizard on Mezmo this week added a free trial and a community plan for the Mezmo Telemetry Pipeline service to make it simpler for DevOps teams to store and manage the large amounts of telemetry data they are collecting.Mezmo CEO Tucker Callaway said as more DevOps teams embrace observability to minimize disruptions to application environments, they are struggling to manage the explosion of data being created.
Cloud Native Microservice To Cloud Agnostic Microservice
https://unsplash.com/photos/BJHN6Do8kjQAs you know, I've been working more with IoT edge use cases around my career.It was going fine with Azure to date, but when we were re-analyzing the architecture, we found a need for cloud-agnostic microservices instead of cloud-native microservices (more precisely with Azure).
Kubernetes has been one of the most adopted technologies in the last couple of years.According to the 2021 Cloud Native Survey conducted by " The Cloud Native Computing Foundation " where they received around 3,829 response overall, around 96% of the organizations are using/evaluating Kubernetes.
How to Ace (PCA) Prometheus Certified Associate Exam
Prometheus and Grafana stack are essential for monitoring Kubernetes systems, focusing on observability and best practices beyond specific tools. [ more ]
5 Reasons to Move Beyond SRE to Observability - DevOps.com
SRE and observability are often mistakenly equated with monitoring.
The role of an SRE is to define how the engineering team should take ownership of their service and establish a culture focused on infrastructure quality and reliability. [ more ]
Chronosphere Acquires Calyptia to Process Log Data More Efficiently - DevOps.com
Chronosphere has acquired Calyptia to enhance its observability platform with additional pipeline management capabilities.
Calyptia's log processors will be embedded into Chronosphere's platform to handle the increasing volume of telemetry data generated by cloud-native applications. [ more ]
Observability for continuous vulnerability assessment and remediation
Observability is crucial for cybersecurity strategies, offering a proactive approach to identifying and addressing vulnerabilities.
Observability provides a comprehensive view of an organization's digital environment, enabling continuous assessment and timely remediation of security challenges. [ more ]
IBM aims to enable multicloud infrastructure control with Hybrid Cloud Mesh | Computer Weekly
Noting that the modern enterprise operates in a hyper-distributed world where users, applications and data can be distributed across multiple locations and environments meaning that they require an offering that improves the network paradigm, IBM has unveiled IBM Hybrid Cloud Mesh, a software-as-a-service (SaaS) offering designed to enable enterprises to bring management to their hybrid multicloud infrastructure.
A contextual logging solution addresses the challenges of finding a relevant log to your issue and seeing all the logs in one place.Using logs in context works in both directions.You can think of it as circular: You can start with reviewing a specific log and then go to the server.And you can start by looking at data for a server and then go to the right log details.
OpenTelemetry metrics is well on its way to approaching general availability, and you'll want to understand this signal to implement it as part of your team's observability strategy.Currently, you can collect some application runtime metrics out of the box with several language SDKs, and you can use the host metrics receiver to generate metrics about your host system.
A herculean effort Of course, both vendors will be working to close these gaps, but they have a long way to go, because this is really hard work!We know firsthand that designing, building, and fine-tuning a highly-scalable, performant, unified observability platform takes years of commitment, focus, and continued investment-and real-world production use-to mature.
How New Relic's Kubernetes Agents team decreased release time by 99% with GitHub workflows
New Relic automated their software agent release process for the Kubernetes integration, reducing deployment time from two weeks to one hour per week.
New Relic improved their response to security vulnerabilities by enabling code-scanning tools in their continuous integration pipeline, automatically patching code without human interaction within a week of a fix being available. [ more ]
Enhancing web debugging using source maps with New Relic browser monitoring
Nonfunctional requirements (NFRs) are important indicators of good applications and vital to the success of a system.
Observability is one aspect of achieving nonfunctional requirements (NFRs) and helps with proactive troubleshooting and optimization of software systems. [ more ]
New Relic AIOps leadership fueled by collaboration with engineers
Within observability, AIOps has emerged as a game changer in the management and operation of complex IT environments, with engineers playing a vital role in safeguarding customer experiences and revenue streams.New Relic is dedicated to providing data to engineers that allows them to fundamentally reshape the way they build and operate critical services so they can optimize their operations, reduce downtime, accelerate innovation, and enhance customer experiences while maintaining engineer happiness.
How does Prometheus collect data?A Prometheus server collects metrics data from its targets using a pull model over HTTP.But what exactly is a pull model, and how is it different from a push model?Push versus pull model On a basic level, it really is as simple as it sounds.A Prometheus server pulls telemetry data from somewhere else.
Building a Dedicated Platform for Frontend Developers at the Norwegian Government
The Norwegian Labour and Welfare Administration has built a dedicated platform for frontend developers, offering services like a CDN, observability stack, and feature management.
The platform is treated as a product, emphasizing user needs, collaboration, and learning to drive adoption and improve the developer experience. [ more ]
Observability is crucial for analyzing the inputs and outputs of LLMs and troubleshooting issues in production.
LLMs like GPT-4 can be limited by the information they were trained on, but frameworks like LangChain and LlamaIndex enable integration with external data sources. [ more ]
Instrumenting AWS Lambda functions with OpenTelemetry SDKs
OpenTelemetry is an open-source project that provides a unified framework for collecting observability data from distributed systems.
Using OpenTelemetry for serverless applications can help overcome challenges related to ephemeral functions and complex invocation patterns.
OpenTelemetry allows for minimal code changes to enable instrumentation and provides flexibility in configuring sampling rate and span attributes. [ more ]
Grafana Labs Acquires Assert.ai to Bring AI to Observability - DevOps.com
Grafana Labs acquired Assert.ai for automating configurations and customization of dashboards.
Grafana Labs is previewing AI capabilities for incident management and diagnostics in Grafana Cloud.
Grafana Labs also announced the availability of an Application Observability module and the general availability of Grafana Beyla, an open-source auto-instrumentation project. [ more ]
How to Build Reliability Into Your Data Stack - DZone
On July 26, 2004, a 5-year-old startup by the name of Google was faced with a serious problem: their application was down.For several hours, users across the United States, France, and Great Britain were unable to access the popular search engine.The then-800-person company and its millions of users were left in the dark as engineers struggled to fix the problem and discover the root cause of the issue.
New Relic Taps Generative AI to Simplify Observability
By: Mike Vizard on New Relic has added a tool that takes advantage of generative artificial intelligence (AI) to make it simpler to query the telemetry data collected by its observability platform via a natural language interface (NLI).Jemiah Sius, director of developer relations for New Relic, said New Relic Grok will make the New Relic One platform more accessible to a wider range of IT professionals, especially those that haven't mastered New Relic's proprietary programming language that enables DevOps teams to identify the root cause of an issue.
DSC Weekly 9 May 2023 - The case for AI-human collaboration - DataScienceCentral.com
Announcements
In addition to ever-increasing volumes of data, storage needs have evolved due to increases in remote work, the use of cloud services, and cybersecurity concerns such as ransomware.In Modern Storage Management summit, learn from top industry experts and solution providers about the latest ways to effectively manage the flood of enterprise data.
Grafana Labs Reins in Cost of Storing Observability Data
By: Mike Vizard on Grafana Labs today made available an ability to customize what observability data is collected via its managed cloud service.This capability can help reduce storage costs in addition to enhancing the dashboard Grafana provides to make it simpler to track metrics usage.Wayne Jin, vice president of product marketing for Grafana Labs, said both capabilities would make it easier for DevOps teams to track and ultimately reduce the cost of storing the time-series data collected via its cloud platform.
By: Mike Vizard on A global survey of nearly 26,000 DevOps professionals published today by the Continuous Delivery Foundation (CDF) at the cdCon + GitOpsCon event found 84% of respondents are involved in some type of DevOps activity.However, the report also found just under half 49% are using a continuous integration (CI) or continuous delivery (CD) platform and only 22% are using CI and CD approaches to automate all building, testing and deployment of code in a production environment.
New Relic Report Surfaces Spike in Amazon JDK Usage
By: Mike Vizard on An analysis of the Java applications observed by New Relic showed nearly one-third of organizations (31%) are using the Amazon Java development kit (JDK) compared to 28% using the Oracle JDK as more Java applications are built and deployed in the cloud.The report also found the number of Java applications running in containers is remaining steady year-over-year at 70%.
By: Mike Vizard on New Relic is preparing to extend the capabilities of its observability platform by making use of both additional machine learning algorithms and the ChatGPT generative artificial intelligence (AI) platform.Peter Pezaris, senior vice president for strategy and experience at New Relic, said during an interview on an episode of TechStrong TV that a prototype of an AI model created using machine learning algorithms will automatically notify developers when code in a production environment is not performing well-right within their integrated development environment (IDE).
Observability as Code Part 2: Automate Alerts and Synthetics
As we've discussed in the previous part of this series, observability as code means automating the configuration of your observability tools.You learned the basics of automating dashboards, and now we're going to expand to ways you can apply observability as code approaches to automate both alerts and synthetic monitoring.
3. Use stack allocations instead of heap allocations.Java stores data in two different kinds of memory structures: the stack and the heap.Most programmers are more familiar with heaps.A heap is a dynamically-allocated pool of memory that is visible to all threads.It's where the Java Virtual Machine (JVM) typically stores objects and classes.
Shifting left isn't just about testing your code and automating the build and deployment process.It's about monitoring and testing your CI and CD pipelines, too.In this post, you'll learn how to monitor your GitLab jobs and pipelines using OpenTelemetry and the New Relic GitLab quickstart.After you're finished, you'll be able to:
Track key metrics on your GitLab pipelines in a pre-built dashboard, such as how long your jobs are taking and how often they are failing.
Observability: A Computer Weekly Downtime Upload podcast
Tim Thompson-Rye - stock.adobe.cListen to this podcast William Hill's Stephen Wild discusses how the betting website reduces the revenue impact of IT glitches
Stephen Wild, the observability manager at William Hill, runs a 10-strong team that looks after everything going on with the IT at the online bookmaker.
How William Hill's IT copes with big sporting events | Computer Weekly
Online bookies need to cope with the usual peaks and troughs around football, horse racing, motorsports and other major sporting events, but few seem to attract the betting level of the Grand National, and if a site is overloaded or taking too long to respond, punters will take their business elsewhere.
Install the Infrastructure Agent using Amazon EC2 Systems Manager
Given the dynamic capabilities of AWS Systems Manager, management and configuration for Amazon Web Services (AWS) cloud infrastructure is more robust than ever before.Observability is a critical part of infrastructure management-and the AWS Systems Manager makes it easier than ever to install, update, or remove the New Relic infrastructure agent when creating Amazon EC2 instances.
Observability-Driven Development vs Test-Driven Development - DZone
The concept of observability involves understanding a system's internal states through the examination of logs, metrics, and traces.This approach provides a comprehensive system view, allowing for a thorough investigation and analysis.While incorporating observability into a system may seem daunting, the benefits are significant.
By proactively monitoring your application, you can resolve issues before they affect your customers.Using New Relic with Pulumi, you can quickly create alerts that you share with your teams, ensuring that you are proactively monitoring your stack.In this post, you'll learn the basics of the following:
What is Pulumi Pulumi versus Terraform
Then you can jump into a hands-on tutorial where you create alerts using Pulumi and New Relic.
Module Federation for distributed front ends-the best of both worlds?
Following on from our previous Beamery Engineering article, "Two years of micro-frontends: a retrospective", we want to dig deeper into the fascinating topic of micro-frontends.The right micro-frontends approach can provide many benefits for organisations.However, if poorly architected, this approach can lead to many critical issues, especially:
Overly complex architecture Problems with shared libraries Poor web performance
Beamery's previous article used an example from Facebook for how to build a modern modular React app.
JFrog Aligns With New Relic to Improve Observability
By: Mike Vizard on JFrog and New Relic jointly announced today they will provide a free integration tool that will enable New Relic's observability platform to consume log data from JFrog platforms for building and deploying applications securely.Announced at the Futurestack conference hosted by New Relic, this integration eliminates the manual effort that was previously required to integrate these platforms.
This week in data: The ML, AI and data landscape with Matt Turck
In this week's video, Bruno breaks down the latest edition of the MAD (Machine Learning, Artificial Intelligence and Data) landscape.FirstMark Capital's managing director Matt Turck also joins the CarCast to discuss the current landscape and key trends.Watch the video below for an in-depth explanation of what's happening in machine learning, artificial intelligence and data today: This week's CarCast covers the following:
Financing trends across public and private markets and how they affect the world of data.
GitHub - oslabs-beta/KnightOwl: An npm package of GraphQL middleware to protect you from malicious queries.
KnightOwl is a middleware library to protect your APIs built on express-graphql servers, combined with a web app monitor to give observability to its activity.Sign in at knightowl.app to utilize our web app monitor in conjunction with the library protecting your GraphQL endpoints.(Please make a note of the email and password you use to signup!) Run the command npm i knightowl to install the Knight Owl Rate Limiter, Cost Limiter, and Depth Limiter middleware functions into your express GraphQL codebase.
7 Data Science Trends for 2023, Top ODSC Recordings from 2022, and Python Constants
7 Data Science Trends You Need to Know Going Into 2023 As we begin a new year, here are some of the top data science trends we saw dominate 2022 that we can expect to be prevalent in 2023.Kubeflow MLOps: Automatic Pipeline Deployment with CI/CD/CT Create an advanced Kubeflow pipeline, and automate its deployments and updates with continuous integration, deployment, and training.
By: Alan Shimel on We will be wrapping up our DevOps coverage for the year by the end of this week.It's hard to believe that another year has gone by.The gravitational lensing of COVID-19 makes it hard to see the progression of the last nine years here at DevOps.com.Things seem to get a bit hazy looking back.
Mezmo Adds Observability Pipeline to Analyze DevOps Data
By: Mike Vizard on At the KubeCon + CloudNativeCon North America conference this week, Mezmo launched an Observability Pipeline platform that promises to make it simpler to manage, enrich and correlate machine data.Previously known as LogDNA, Mezmo is expanding the scope of its reach to add the ability to augment and analyze data on top of its core log management platform.
Using Terraform to generate New Relic dashboards from NRQL queries
The jsondecode() function extracts the data we need from the results and assigns it to the CONFIG variable.The shape of the CONFIG data is slightly different from how it looked in previous parts in order to accommodate the query result data.jsondecode(data.graphql_query.basic_query.query_response).data.actor.account.nrql.results