3 days agoHow to Build a Ceph Cluster and Integrate with the JuiceFS File SystemCeph provides object storage and can be used as a storage engine in JuiceFS. This combination is well-suited for data-intensive applications such as cloud computing, big data analytics, and machine learning. In daily deployments, you can directly use Ceph RADOS in conjunction with JuiceFS without the need to deploy RGW…11 min read11 min read
Nov 246 Essential Tips for JuiceFS UsersAs big data and artificial intelligence (AI) technologies continue to evolve, more enterprises, teams, and individuals are adopting JuiceFS, an open-source high-performance distributed file system designed for the cloud. This article compiles six practical tips to help you enhance management efficiency of JuiceFS, including: Viewing mounted file systems Streamlining management…6 min read6 min read
Nov 17Is POSIX Really Unsuitable for Object Stores? A Data-Backed AnswerTL;DR: The author of this post questions the perspective presented in a MinIO article, which suggests that POSIX is not a suitable fit for object stores. He conducted comprehensive tests involving MinIO, s3fs-fuse, and JuiceFS. Results indicate that MinIO and JuiceFS deliver excellent performance, while s3fs-fuse lags. …Storage10 min readStorage10 min read
Nov 1From Hadoop to Cloud: Why and How to Decouple Storage and Compute in Big Data PlatformsThe advent of Apache Hadoop Distributed File System (HDFS) revolutionized the storage, processing, and analysis of data for enterprises, accelerating the growth of big data and bringing about transformative changes to the industry. Initially, Hadoop integrated storage and compute, but the emergence of cloud computing led to a separation of…Big Data14 min readBig Data14 min read
Oct 27A Deep Dive into the Design of Directory Quotas in JuiceFSJuiceFS introduced the directory quota feature in version 1.1. The released commands support setting quotas for directories, fetching directory quota information, and listing all directory quotas. For details, see the Command Reference document. In designing this feature, our team went through numerous discussions and trade-offs regarding its accuracy, effectiveness, and…Storage9 min readStorage9 min read
Oct 20Comparative Analysis of Major Distributed File System Architectures: GFS vs. Tectonic vs. JuiceFSAs technology advances and data continues to explode, traditional disk file systems have revealed their limitations. To address the growing storage demands, distributed file systems have emerged as dynamic and scalable solutions. …10 min read10 min read
Oct 13Building a Cloud-Native File Storage Platform to Host 5B+ Files in AI Training & MoreXiaomi is one of the world’s leading smartphone companies. It has also established the world’s leading consumer AI+IoT platform, with 654.5 million smart devices connected to its platform as of June 30, 2023. Xiaomi products are present in 100+ countries and regions around the world. We’ve extensively incorporated AI technology…Big Data8 min readBig Data8 min read
Oct 7Costs Cut & Ops Efficiency Boosted: Switching to a Big Data Storage-Compute Decoupled ArchitectureDMALL is Asia’s leading omnichannel digital retail solution provider. It has partnered with 380 retail enterprises and nearly 1,000 brands, spanning 6 countries and regions. It digitally reconstructs the retail industry, offering end-to-end business SaaS services. As our business developed and data grew, our storage-compute coupled architecture became unsatisfactory. We…Big Data8 min readBig Data8 min read
Sep 22GlusterFS vs. JuiceFSGlusterFS is an open-source software-defined distributed storage solution. It can support data storage of PiB levels within a single cluster. JuiceFS is an open-source, high-performance distributed file system designed for the cloud. It delivers massive, elastic, and high-performance storage at low cost. This article compares the key attributes of JuiceFS…Storage6 min readStorage6 min read
Sep 1550%+ Cut in Both Storage & Compute Costs: Designing NetEase Games’ Cloud Big Data PlatformNetEase Games, a division of NetEase, Inc. (NASDAQ: NTES and HKEX: 9999), is one of the largest Internet and video game companies in the world. Our portfolio includes popular titles like Knives Out, Harry Potter: Magic Awakened, and Naraka: Bladepoint. …Big Data11 min readBig Data11 min read
