Here are 7 public repositories matching this topic...

rustfs / rustfs

🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.

rust filesystem bigdata s3 minio cloud-native objectstorage object-storage multi-cloud amazon-s3 ai-storage ai-native

Updated Mar 17, 2026
Rust

russfellows / s3dlio

Part of the sai3 project that delivers multi-protocol storage access for AI/ML workflows, supporting Pytorch, Tensorflow and Jax. This project provides a CLI, along with Rust and Python libraries for AI/ML storage workflows. Supporting S3, File, Azure Blob and GCS using the latest Rust SDKs.

rust tensorflow aws-s3 python-library s3 pytorch gcs azure-blob file-io rust-crate jax ai-ml ai-storage sai3

Updated Mar 15, 2026
Rust

Develop-Packt / Introduction-to-the-Ethics-of-AI-Data-Storage

You will look at several case studies, examining everything from AI being used to manipulate elections, to AI displaying racial and sexist prejudices. Implement a simple sentiment classifier to differentiate between positive and negative words and sentences. You'll observe how this works in many cases, and display the problematic biases and huma…

artificial-intelligence data-manipulation ethics intermediate ai-storage

Updated Apr 27, 2020

Develop-Packt / Handling-Big-Data-File-Formats

You will look at the different formats for storing, transmitting and organizing very large collections of data. You will learn how to choose the right data formats as well as look at compression.

compression big-data artificial-intelligence intermediate data-formats ai-storage

Updated Apr 28, 2020
Scala

Develop-Packt / Working-with-Data-Stores-SQL-and-NoSQL-Databases

We will look at SQL and NoSQL databases and decide the ideal database to be used based on the format of data. Then you will implement storing and querying data in different databases such as MySQL, MongoDB, and Cassandra.

mysql sql cassandra mongodb nosql artificial-intelligence intermediate ai-storage

Updated Apr 23, 2020
JavaScript

Hoangstephen / shelby-aptos-provenance

High-performance AI data storage pipeline utilizing Shelby's global object storage and Aptos blockchain for verifiable data provenance. Optimized for low-latency AI workloads.

decentralized-storage shelby ai-storage aptos-blockchain web3-infrastructure

Updated Mar 12, 2026
JavaScript

Develop-Packt / Introduction-to-Analytics-Engine-Spark-for-Big-Data

Discover the fundamentals of Apache Spark, including its architecture, transformations and actions. Learn why the design choices of RDD were made and how this enhances the Hadoop and MapReduce construct.

spark hadoop artificial-intelligence intermediate ai-storage

Updated Apr 28, 2020
Jupyter Notebook