Extract Cloud Computing Data: A Guide to Using SpareCores' sc-data

Are you searching for a streamlined way to gather and structure information about cloud computing resources? Look no further! SpareCores' sc-data library provides a powerful solution for collecting and standardizing data from various cloud providers. Let's dive into how you can put this tool to work.

{width=400}

The sc-data library leverages sparecores-crawler to automatically fetch and organize data on cloud compute resources. It's designed to simplify data acquisition, allowing you to focus on analysis and decision-making.

Why Use sc-data for Cloud Resource Data?

This tool offers several key advantages:

• Automated Data Collection: Fetches data on spot prices every 5 minutes.
• Comprehensive Resource Information: Updates cloud resource data hourly.
• Standardized Data: Provides consistent data structures for easy analysis.
• Easy Access: Offers a public SQLite snapshot for convenient querying.

Simple Installation Steps

Ready to get started? There are two straightforward options for installation:

Install from PyPI (Stable Version):

This method installs the latest stable release.

pip install sparecores-data

Install from GitHub (Most Recent Version):

To access the cutting-edge features and the latest updates:

pip install "sparecores-data @ git+https://[email protected]/SpareCores/sc-data.git"

Quick Start: Accessing the SQLite Database

The sc_data Python package is designed for easy access to the SQLite database. The background updater thread keeps the SQLite file current, ensuring you always have the latest information.

from sc_data import db
print(db.path)

This simple code snippet prints the path to the SQLite database file, enabling you to start querying immediately. By default the SQLite file updates every 600 seconds. You have the flexibility to adjust this refresh interval as needed. You can modify this using the sc_data_db_refresh_seconds attribute or the SC_DATA_DB_REFRESH_SECONDS environment variable.

Key Resources & Documentation

For further exploration, consult these helpful resources:

• sparecores-crawler Documentation: In-depth information about the data collection process.
• Database Schemas: Detailed information about the database structure.
• Latest SQLite Database Release: Download the latest snapshot for direct querying.
• sparecores.com: Explore more about SpareCores and their offerings.

License & Project Status

sc-data is licensed under the CC-BY-SA-4.0 license, ensuring its availability and encouraging community contributions. The project is currently in Alpha and actively maintained, indicating ongoing development and improvements.