Metabase is a business intelligence tool that lets you access your data in a read-only manner.
Recently I needed to delete some documents that I saved in MongoDB after some time. I can think of a few examples of why we would want to delete data after some time:
Parsing SQL queries provides superpowers for monitoring data health. This post describes how to get started on parsing SQL for data observability.
With the launch of Rails 6, one of the new features that were announced was of multiple database support.
One of these issues you might stumble across using the PHP framework Laravel is this one:
Object oriented database is a type of database system that deals with modeling and creation of data as objects. The main advantage of this database is the cons
Race conditions in a database and how you can solve them using techniques such as pessimistic and optimistic concurrency control.
During the last couple of decades websites' functionally has increased dramatically - from simple landing pages serving simple static ads to complex progressive web apps whose functionality close to native applications including user authorization, location tracking, bluetooth handling, and offline mode.
ChatGPT is truly impressive. You can instruct it to do all sorts of things when they can be communicated in plain text.
How to customize MariaDB Docker images: Execute SQL and shell scripts when the containers start and pass configuration files.
Continuous Integration, shortly called ‘CI’ in DevOps is an important process or a set of processes that are defined and carried out as a part of a pipeline called Build Pipeline or CI Pipeline.
PostgreSQL replication using python and RabbitMQ for providing your database server with High Availability by easily making replicas of your master server.
Choosing a database can be scary as it’s nearly impossible to change once you’ve built on one. So which will you choose? PostgreSQL or MongoDB?
Ok, so here is the situation: you work in a team, and each developer works with a local environment. Or you have multiple environments. Or... We don't care. The only thing is, you have to handle different versions of databases, and you don't know how to do this safely and efficiently.
Server-sent events (SSE) is a way to send data to the browser without reloading the page.
Here's an example of Database testing with the MariaDB Server, one of the most popular open-source relational databases.
This is a tutorial on how to install, use, and patch the Oracle Database Docker Image. Docker is a PaaS that delivers software in packages called containers.
How Can You Sort Through Online Data?
I was recently going through my notes of SQL Antipatterns and was shocked to realize how actual this book still is.
Smart contract developers need a web3 native database to decouple dapps and data. Tableland makes a nice try.
Learn how to use databases from Java
Why do we need Edge Computing? Why is the cloud not the solution for everything? Why is Edge Computing adoption taking so long? What's the solution to it?
How to use populate() method with mongoDB to itch data across referenced collections
Faster, Better Insights: Why Networked Data Platforms Matter for Telecommunications Companies
Learn more about the universally unique identifier (UUID) and how using UUID in your QuestDB instance can help reduce query time as well as save storage space.
In this article, I covered the use of a freeware application called FDR which can help you recover corrupt or damaged MS SQL databases.
Was really confused whether to have the title as “Blockchain: Beyond a database” or “Blockchain: A combination of technology and social engineering” but decided on the former with the expectation that it might come easily in search engines.
To set up replication for a new fresh MariaDB server, you can just enable the binary log in the primary and configure the connection in the replica.
Consistency, availability, and partition tolerance are the three musketeers of distributed systems. They ensure that your system operates correctly.
It’s expected that developers face many of the same issues when starting their NoSQL journey with DynamoDB. This article might clear things up a bit.
Normal development flow requires continuous patching the production database with local changes normally made automatically by the orm software, this method is not perect but deceptively simple, all we'll use is standard Unix commands, and is good enough for us.
As Ruby on Rails developers, we do not have to worry too much about the operations in the database due to the Object-Relational-Mapping or ORM. The ORM allows us to focus more on the logic of the business while it handles the operations with the database on our behalf.
If securing your company’s intellectual property is such a complex process, how can business leaders efficiently defend their assets? Use multiple databases.
Canonical just did a very interesting thing to the venerable SQLite, one of the most used databases in the world, it is written in C, is small, tight and fast so it is common for applications to use it for structured storage on limited devices like mobile phones, IoT, etc.
WunderBase is a Serverless Database with a GraphQL API on top of SQLite, Firecracker/Fly machines, and Prisma.
Jenkins, GitLab, Travis, Circle CI are great for DevOps but not so great for your compliance records - here's why.
First of all what is Stored Procedure?
PostgreSQL and MySQL are both reliable, secure and scalable databases that have been around for years.
A tutorial that explains how a database proxy like MariaDB MaxScale serves as a transparent read/write splitter that scales SQL queries.
Nowadays, most assertions need to be backed with data, as such, it is not uncommon to encounter data that has been manipulated in some way to validate a story.
We will build a simple dashboard app that displays data from a Deno Web Socket server.
In this article, we will be discussing the ways to optimize the database for speed in Django applications.
There are no strict rules on how to plan your work, but scribbling your ideas in a notebook, organising your requirements, and even generating pseudocode helps.
In this article, I will be showing you how to build a reliable data pipeline for your small business to improve your productivity and data security.
In this article, we’ll observe another test with1.1M Hacker News curated comments with numeric fields
How to connect various data sources easily and ensure high query performance.
Creating .Net MVC project using Visual Studio Mac
The Hyper-V and VMware virtual environments may seem similar, but upon closer inspection, a number of important differences between these two platforms.
Are you someone who would like to learn Web Development, but don’t know where to start? Well, you are in the right place.
I am a full-stack developer student currently doing the Microverse program, and I've been developing things for months until now. This article is for helping newcomers to Rails to understand Rails migrations by showing some examples and explaining them the best I can.
Manage data using the HarperDB database. Access your data from HarperDB using Custom Function. Automate EDA with data from the harperDB database using sweetviz.
For a database administrator, the common everyday practice involves running multiple operations targeted at ensuring database security and integrity. Thus, we shouldn’t overlook the importance of sensitive data stored in the database under any circumstances. In light of this, we are excited to demonstrate the new ADD SENSITIVITY CLASSIFICATION command introduced in SQL Server 2019, which allows adding the sensitivity classification metadata to database columns.
I'll show how to use Macie to scan any database, inclusive on-premises, to discover sensitive data on tables.
Ruby and the Rails framework are both under active development and regular updates are released for both all year round
The article explains optimistic and pessimistic locking. We consider a Spring Data JPA application with concurrent transactional code as an example.
Learn about the options for vector databases and how each works.
Multi-region application architecture is a key way to solve a lot of potential headaches with globally distributed apps. It makes applications more resilien
An exploration of AlloyDB's architecture and design, focussing on its storage engine, with descriptions of how it handles reads and writes
Learn reasons why you should choose SuperTokens as your auth provider and why it pairs so well with Supabase in protecting you and your online infrastructure
What's the most efficient way to store market data? SQL or NoSQL? Let's compare 5 most common options and find out what is best.
People are still using autoincrementing integer ids in postgres in 2023 and they shouldn't be! UUIDs are leaps and bounds better.
The DB3 Network is a start-up project to build a decentralized, permissionless platform for programmable data processing.
The resurgence of SQL-based RDBMS
Learn how to connect a self-hosted SuperTokens core to a database with or without Docker
The 17.5 version of SQL Server Management Studio (SSMS) brought with it a new built-in security tool. Since then, the Data Discovery and Classification feature has become a difference-maker in the protection of sensitive information.
This article introduces the design and implementation of metadata storage in Alluxio Master, either on heap and off heap (based on RocksDB).
To do estimates of SQL queries we need to understand how DB works with queries. Let's find out what exactly the db do with queries.
NoSQL got quite some hype a few years back. It was going to solve your scaling, uptime, and speed problems. There were trade-offs, of course, but, for a brief moment, seemingly everything we knew about storing and querying data was up for grabs.
Imagine — You’re in a system design interview and need to pick a database to store, let’s say, order-related data in an e-commerce system. Your data is structured and needs to be consistent, but your query pattern doesn’t match with a standard relational DB’s. You need your transactions to be isolated, and atomic and all things ACID… But OMG it needs to scale infinitely like Cassandra!! So how would you decide what storage solution to choose? Well, let’s see!
If it is not going to be used by a smart contract, dump it in an event
There is a lot of information about different T-SQL features. I want to tell you about equally useful, but less popular tips for working with this language!
Image a situation wherein you have just launched your app. But the data of your app is not being properly displayed or you are not able to fetch the data that is being entered by the users. What will be the impression of your app in the user’s mind?
Engineering is about dividing problems into smaller partials. And then solving them with the best approach. As an engineer, I enjoy problem-solving.
If you’re still doing manual migrations on the database you’re doing it wrong. Databases are as much part of the application as the code.
This is a step-by-step guide for deploying a Strapi v4 project to DigitalOcean's App Platform with managed mySql Database.
HarperDB is more than just a database, and for certain users or projects, HarperDB is not serving as a database at all. How can this be possible?
By adding support for JSON, MariaDB provides the ultimate schema flexibility without sacrificing transactions or data integrity.
How to gather data without those pesky databases.
The best way to implement the observer pattern - using transaction logs of databases.
A lot of data over the web or internally in an enterprise is available and accessible only through Rest APIs. Rest APIs do provide a secure and authenticated mechanism to access these services, but they are not very intuitive sometimes to query upon the data which is fetched through them.
Illustration composed from MariaLetta/free-gophers-pack, original gopher by Renee French.
How to map UML to TypeQL. Read how the European Space Agency migrated their spacecraft engineering models from UML to TypeQL for use in a TypeDB database.
In simple terms, a database is a collection of information. It is organized to ensure easy accessibility, management, and updates.
Feel free to contribute on GitHub 💚
Technical design. Because one of the most common use cases of the new databases is storing data that is generated by high-throughput sources, it is important that the store engine is able to handle write-intensive workloads, all while offering acceptable read performance. RocksDB implements what is known in the database literature as a log-structured merge tree aka LSM tree.
This article will provide an overview on database architectures, including use cases and pros & cons for each of them.
How a type system can bring speed and novelty to your discovery pipeline.
Are you looking for a career in Backend Development? To build complete applications beyond the user-interface companies need rockstar back-end developers.
All the app data is stored and processed on the back-end. Back-end development is everything that happens behind the scenes. It is a variety of things like the databases, the business logic, the API layer and pretty much everything other than the user-interface.
The average salary for a back-end developer is $123,689 per year in the United States as of 2019. In this post, let’s learn about what it means to be a Backend Developer.
Developers often fear database changes because a mistake by anyone on your team can lead to a major outage and even data loss. The stakes are higher when changes are not backwards compatible, cannot be rolled back, or impact system performance. This can cause a lack of confidence and slow your team velocity. As a result, database changes are a common failure point in agile and DevOps.
Learn what database connection pools are, why you should use them, and how
In a microservice architecture, you can get dependencies that impose restrictions on the services used
Latency is caused by offloading processing from an app to an external server. But what if there was a solution to the monolithic common single-cloud geography?
YAML: literally meaning “Yaml ain’t markup language” can mess you up in the beginning. Rails generates this file for you and you have to change it for Heroku. YAML spacing has to be exact and it’s important to know a tab is not the same as four spaces.
In this test we use the data collection of 1.1M Hacker News curated comments with numeric fields from https://zenodo.org/record/45901.
The first step is to understand what is data governance. Data Governance is an overloaded term and means different things to different people. It has been helpful to define Data Governance based on the outcomes it is supposed to deliver. In my case, Data Governance is any task required for:
Companies Must Transform Or Else (Photo by eelnosiva on Adobe)
Postgres Handles More than You Think
Learn how to build an n8n workflow that processes text, stores data in two databases, and sends messages to Slack.
Have that old laptop that's just in the back of your closet? Figure out how to give it a new life!
How to make clean pagination with no additional dependencies. Basically for Node.js but can be used in any other languages and platforms.
For now, I am assuming that you all know what is SQL or you have some experience with SQL or you are using SQL for many years. I know many people who know so much about SQL and even have created many projects based on SQL and they do not know what is SQL engine or how actually SQL database engine works. It’s obvious no one’s care about the internal working of SQL engine or something because without knowing How SQL works we can still create and access database using any SQL program.
When you think about database providers for ASP NET Core apps, you probably think about Entity Framework Core (EF Core), which handles interacting with SQL databases. But what about the NoSQL options? A popular option for NoSQL is MongoDB. So in this article we're going to learn how to create a simple ASP NET Core CRUD API using MongoDB as the database provider.
Data modeling is probably one of the most important and potentially challenging aspects of Cassandra. CQL will look familiar if you come from a relational background, but the way you use it can be very different. For our third guide, we will walk you through the process of creating a basic data model. Read part one on Cassandra essentials and part two on bootstrapping.
What are medical databases?Medical Databases serve as an essential part in medical care, which includes the disciplines of research, documentation, patient care and treatment. The medical industry is constantly on the lookout for new medical applications, which would help improve their services. These endeavors are usually done through databases, which store data regarding diseases, diagnosis, treatments, medication, medical devices, medical practices and other pertinent details about medical professionals. With the constant advancements made in technology, these databases have also grown to be more technologically advanced and complex.
This article uses Exercise number 10 on the Self JOIN SQL ZOO tutorial to teach self JOINs in a beginner-friendly way.
As you get into the Databases and Data Science, the first thing that you have to master is the relations between entities in your database. That is important because the data that you use has to be absolutely efficient for its further implementations.
Our first article covered Cassandra essentials: the “what” and “why” about the architecture. If you’re ready to try Cassandra, the next few articles will explain the “how.” At the end of these tutorials you should have a database up and running, experienced using Cassandra Query Language (CQL), gained some practical data modeling expertise, and learned best practices for building applications with Cassandra.
How to ensure that expiring Spring Cloud Vault dynamic database secrets are renewed, when reaching Hashicorp Vault’s max_ttl
Building a biomedical knowledge graph using publicly available datasets to better aid disease research and biomedical data modelling.
Express is one of the most popular JavaScript frameworks for building backend APIs and Postgres is a really popular relational database. How do we connect them?
Rotate Expiring Spring Cloud Vault Database Credentials Without Downtime
115. “I’m Too Small To Be Targeted,” Is No Longer A Valid Argument in 2021: A Database Security Checklist
“I’m too small to be targeted,” is a phrase you might say to yourself. Let’s swiftly get that notion out of our minds.
In this article, you will learn how to set up a Heroku Postgres database with Librato for automated monitoring.
For some time now I’ve been making an unassailable and unchallenged argument that Bitcoin and Bitcoin services are no different to the monies and services found in video games. Now, thanks to my favourite gamer, we have one of the best examples yet of “Bitcoin Doublethink”, second only to the very cute Pigsby which uses a “Blockchain” for its database.
There are several patterns out there for handling data in microservices development. The most familiar one being the CRUD pattern.
Is there life after COVID-19? Of course there is, even though it may be quite different, and it may be hard to get there. But there’s one thing in common in the “before” and “after” pictures: science and technology as the cornerstones of modern society, for better or worse.
This manual describes the process of setting up continuous backups for PostgreSQL databases to safeguard your data from accidental loss in an efficient way.
Jason Repp is the SVP of HarperDB, a world-leading database and development platform that is leading the charge in terms of performance, flexibility, and ease.