Audience
Developers in need of a tool to optimize their compute-intensive applications and streamline their data processing operations
About Amazon FSx for Lustre
Amazon FSx for Lustre is a fully managed service that provides high-performance, scalable storage for compute-intensive workloads. Built on the open-source Lustre file system, it offers sub-millisecond latencies, up to hundreds of gigabytes per second of throughput, and millions of IOPS, making it ideal for applications such as machine learning, high-performance computing, video processing, and financial modeling. FSx for Lustre integrates seamlessly with Amazon S3, allowing you to link file systems to S3 buckets. This integration enables transparent access and processing of S3 data from a high-performance file system, with the ability to import and export data between FSx for Lustre and S3. The service supports multiple deployment options, including scratch file systems for temporary storage and persistent file systems for long-term storage, as well as SSD and HDD storage types to optimize cost and performance based on workload requirements.
Other Popular Alternatives & Related Software
AWS DataSync
AWS DataSync is a secure, online service that automates and accelerates moving data between on-premises storage and AWS Storage services. It simplifies migration planning and reduces expensive on-premises data movement costs with a fully managed service that seamlessly scales as data loads increase. DataSync can copy data between Network File System (NFS) shares, Server Message Block (SMB) shares, Hadoop Distributed File Systems (HDFS), self-managed object storage, AWS Snowcone, Amazon Simple Storage Service (Amazon S3) buckets, Amazon Elastic File System (Amazon EFS) file systems, Amazon FSx for Windows File Server file systems, Amazon FSx for Lustre file systems, Amazon FSx for OpenZFS file systems, and Amazon FSx for NetApp ONTAP file systems. It also supports moving data between other public clouds and AWS Storage services, enabling replication, archival, or sharing of application data easily. DataSync provides end-to-end security, including data encryption and data integrity.
Learn more
Lustre
The Lustre file system is an open-source, parallel file system that supports many requirements of leadership class HPC simulation environments. Whether you’re a member of our diverse development community or considering the Lustre file system as a parallel file system solution, these pages offer a wealth of resources and support to meet your needs. The Lustre file system provides a POSIX-compliant file system interface, which can scale to thousands of clients, petabytes of storage, and hundreds of gigabytes per second of I/O bandwidth. The key components of the Lustre file system are the Metadata Servers (MDS), the Metadata Targets (MDT), Object Storage Servers (OSS), Object Server Targets (OST), and the Lustre clients. Lustre is purpose-built to provide a coherent, global POSIX-compliant namespace for very large-scale computer infrastructure, including the world's largest supercomputer platforms. It can support hundreds of petabytes of data storage.
Learn more
Amazon EC2 UltraClusters
Amazon EC2 UltraClusters enable you to scale to thousands of GPUs or purpose-built machine learning accelerators, such as AWS Trainium, providing on-demand access to supercomputing-class performance. They democratize supercomputing for ML, generative AI, and high-performance computing developers through a simple pay-as-you-go model without setup or maintenance costs. UltraClusters consist of thousands of accelerated EC2 instances co-located in a given AWS Availability Zone, interconnected using Elastic Fabric Adapter (EFA) networking in a petabit-scale nonblocking network. This architecture offers high-performance networking and access to Amazon FSx for Lustre, a fully managed shared storage built on a high-performance parallel file system, enabling rapid processing of massive datasets with sub-millisecond latencies. EC2 UltraClusters provide scale-out capabilities for distributed ML training and tightly coupled HPC workloads, reducing training times.
Learn more
Amazon ElastiCache
Amazon ElastiCache allows you to seamlessly set up, run, and scale popular open-Source compatible in-memory data stores in the cloud. Build data-intensive apps or boost the performance of your existing databases by retrieving data from high throughput and low latency in-memory data stores. Amazon ElastiCache is a popular choice for real-time use cases like Caching, Session Stores, Gaming, Geospatial Services, Real-Time Analytics, and Queuing. Amazon ElastiCache offers fully managed Redis and Memcached for your most demanding applications that require sub-millisecond response times. Amazon ElastiCache works as an in-memory data store and cache to support the most demanding applications requiring sub-millisecond response times. By utilizing an end-to-end optimized stack running on customer-dedicated nodes, Amazon ElastiCache provides secure, blazing-fast performance.
Learn more
Pricing
Starting Price:
$0.073 per GB per month
Integrations
Company Information
Amazon
Founded: 1994
United States
aws.amazon.com/fsx/lustre/
Videos and Screen Captures
Other Useful Business Software
Attack Surface Management | Criminal IP ASM
Criminal IP’s Attack Surface Management (ASM) is a threat-intelligence–driven platform that continuously discovers, inventories, and monitors every internet-connected asset associated with an organization, including shadow and forgotten resources, so teams see their true external footprint from an attacker’s perspective. The solution combines automated asset discovery with OSINT techniques, AI enrichment and advanced threat intelligence to surface exposed hosts, domains, cloud services, IoT endpoints and other Internet-facing vectors, capture evidence (screenshots and metadata), and correlate findings to known exploitability and attacker tradecraft. ASM prioritizes exposures by business context and risk, highlights vulnerable components and misconfigurations, and provides real-time alerts and dashboards to speed investigation and remediation.
Product Details
Platforms Supported
Cloud
On-Premises
Training
Documentation
Webinars
In Person
Videos
Support
Phone Support
24/7 Live Support
Online
