Archive

Posts Tagged ‘database’

Eventually Consistent – Revisited – All Things Distributed

August 23rd, 2010

In the mid-’90s, with the rise of larger Internet systems, these practices were revisited. At that time people began to consider the idea that availability was perhaps the most important property of these systems, but they were struggling with what it should be traded off against. Eric Brewer, systems professor at the University of California, Berkeley, and at that time head of Inktomi, brought the different trade-offs together in a keynote address to the PODC (Principles of Distributed Computing) conference in 2000.1 He presented the CAP theorem, which states that of three properties of shared-data systems—data consistency, system availability, and tolerance to network partition—only two can be achieved at any given time. A more formal confirmation can be found in a 2002 paper by Seth Gilbert and Nancy Lynch.4
(Link: Eventually Consistent – Revisited – All Things Distributed)

Uncategorized , ,

Why I think Mongo is to Databases what Rails was to Frameworks // RailsTips by John Nunemaker

July 15th, 2010

Strong statement, eh? The more I work with Mongo the more I am coming around to this way of thinking. I tell no lie when I say that I now approach Mongo with the same kind of excitement I first felt using Rails. For some, that may be enough, but for others, you probably require more than a feeling to check out a new technology.

1. Migrations are Dead
2. Single Collection Inheritance Gone Wild
3. Array Keys
4. Hash Keys
5. Embedding Custom Objects
6. Incrementing and Decrementing
7. Files, aka GridFS
(Link: Why I think Mongo is to Databases what Rails was to Frameworks // RailsTips by John Nunemaker)

Uncategorized ,

Clustrix Builds the Webscale Holy Grail: A Database That Scales

May 8th, 2010

Clustrix, a Y Combinator graduate from 2006, launched today with the claim that it’s built a transaction database with MySQL-like functionality and reliability that can scale to billions of entries. Clustrix plans to sell its appliance (which consists of more than a terabyte of memory and its proprietary software) to web firms that don’t want to take on the complicated task of sharding their data (replicating it across multiple databases), or moving to less robust database options like Cassandra or a key value store such as what’s provided by Twitter.
(Link: Clustrix Builds the Webscale Holy Grail: A Database That Scales)

Uncategorized

Sequel: The Database Toolkit for Ruby

April 27th, 2010

Sequel provides thread safety, connection pooling and a concise DSL for constructing database queries and table schemas.
Sequel also includes a lightweight but comprehensive ORM layer for mapping records to Ruby objects and handling associated records.
Sequel supports advanced database features such as prepared statements, bound variables, stored procedures, master/slave configurations, and database sharding.
Sequel makes it easy to deal with multiple records without having to break your teeth on SQL.
Sequel currently has adapters for Amalgalite, ADO, DataObjects, DB2, DBI, Firebird, Informix, JDBC, MySQL, ODBC, OpenBase, Oracle, PostgreSQL and SQLite3.
(Link: Sequel: The Database Toolkit for Ruby)

Uncategorized , ,

Introducing Java DB Migrations

February 24th, 2010

Here at Carbon Five we have the luxury of working on many projects, so anything we can do to make things easier will pay off in multiplicity across new projects. One of the things that we have to deal with on every project is maintaining a database schema over time. We’ve had a manual process of capturing changes in incremental db patch scripts for a while, but it was error prone and sometimes neglected. We’ve been doing more Ruby on Rails work and found Rails Migrations easy to work with and a real time saver. We wanted something that would make our lives easier when working on Java projects in the same way Migrations improve Rails development. With that manifest in mind, Alon and I collaborated on a simple Java database migration framework.
(Link: Introducing Java DB Migrations)

Uncategorized , ,

trafficbroker’s sequel at master – GitHub

February 21st, 2010

# Sequel provides thread safety, connection pooling and a concise DSL for constructing database queries and table schemas.
# Sequel also includes a lightweight but comprehensive ORM layer for mapping records to Ruby objects and handling associated records.
# Sequel supports advanced database features such as prepared statements, bound variables, stored procedures, master/slave configurations, and database sharding.
# Sequel makes it easy to deal with multiple records without having to break your teeth on SQL.
# Sequel currently has adapters for ADO, Amalgalite, DataObjects, DB2, DBI, Firebird, Informix, JDBC, MySQL, ODBC, OpenBase, Oracle, PostgreSQL and SQLite3.
(Link: trafficbroker’s sequel at master – GitHub)

Uncategorized ,

FleetDB is a schema-free database optimized for agile development.

January 5th, 2010

a combination of schema-free records, declarative queries, automatically maintained indexes, and an optimizing query planner make it easy to manipulate and retrieve data.
(Link: FleetDB is a schema-free database optimized for agile development.)

Uncategorized ,

Backup2Mail — Send MySQL database backup to your mailbox

November 22nd, 2009

Backup2Mail is mini PHP application that creates regular backups of your MySQL database and sends it to configurable e-mail address. The whole process is scheduled with a help of Cron, a Unix program that runs programs at scheduled times.
(Link: Backup2Mail — Send MySQL database backup to your mailbox)

Uncategorized , ,

The dark side of NoSQL – Code Monkeyism

September 30th, 2009

The three problems no-one talks about – almost noone, I had a good talk with the Infinispan lead [1] – are:

* adhoc data fixing – either no query language available or no skills
* adhoc reporting – either no query language available or no in-house skills
* data export – sometimes no API way to access all data
(Link: The dark side of NoSQL – Code Monkeyism)

Uncategorized , ,

AggData – data sets. for example a set of AggData to describe countries would be a list of every country in the world

September 24th, 2009

AggData is short for aggregate data, which means a set of data that is collected together in one place. On this site, the AggData will come in the form of a list of records, where each record has details about a specific object in the group. For example, a set of AggData to describe countries would be a list of every country in the world, perhaps with details such as capital city, land area, population, and so forth. The raw data might look like the following:

Afghanistan, Kabul, 647,500 sq km, 31,056,997
Albania, Tirana, 28,748 sq km, 3,581,655
Algeria, Algiers, 2,381,740 sq km, 32,930,091

and so on. While this information is already publicly available on the web, the advantage of AggData is that the data is collected into one file that is very raw and portable, which makes it easy to integrate into any application or website.
(Link: AggData – data sets. for example a set of AggData to describe countries would be a list of every country in the world)

Uncategorized , ,

Heterogeneous Data Layers? Check. What’s Next?

July 2nd, 2009

Bosworth goes on to describe the three major problems not being adequately solved by traditional commercial databases: 1) Dynamic schema, 2) Dynamic partitioning, and 3) Modern indexing.
(Link: Heterogeneous Data Layers? Check. What’s Next?)

Uncategorized , ,

Dabble DB – Online Databases

June 9th, 2009

Dabble DB is a web-based application that lets you work with data on your own terms. Instead of downloading an application, you upload your data and then build your own database application. Screenshot of a table view You can import existing data or just start from scratch. Extend it or change it as you go. Restructure and redefine how you organize your data on a whim.
(Link: Dabble DB – Online Databases)

Uncategorized , ,

Walmart adds a billion rows of data to its 600 terabyte database per minute

June 5th, 2009

Twitter / Kas Thomas, Analyst: Walmart adds a billion rows of data to its 600 terabyte database per minute, according to Formtek’s Dick Weisinger
(Link: Walmart adds a billion rows of data to its 600 terabyte database per minute)

Uncategorized

Scalable Web Architectures: Common Patterns and Approaches – Web 2.0 Expo NYC

May 5th, 2009

Slideshow talking about scalability, HA, load balancing, etc
(Link: Scalable Web Architectures: Common Patterns and Approaches – Web 2.0 Expo NYC)

Uncategorized , , ,

Ruby Sequel – The Database Toolkit for Ruby (link)

March 30th, 2009

Ruby Sequel – The Database Toolkit for Ruby
# Sequel provides thread safety, connection pooling and a concise DSL for constructing database queries and table schemas.
# Sequel also includes a lightweight but comprehensive ORM layer for mapping records to Ruby objects and handling associated records.
# Sequel makes it easy to deal with multiple records without having to break your teeth on SQL.
# Sequel currently has adapters for ADO, DB2, DBI, Informix, JDBC, MySQL, ODBC, OpenBase, Oracle, PostgreSQL and SQLite3.

Uncategorized , , ,