Search Results for "data processing"
Sort By:
Showing 43 open source projects for "data processing"
View related business solutions-
Globalscape Enhanced File Transfer (EFT) is a best-in-class managed file transfer (MFT) solutionGlobalscape’s Enhanced File Transfer (EFT) platform is a comprehensive, user-friendly managed file transfer (MFT) software. Thousands of Windows-Centric Organizations trust Globalscape EFT for their mission-critical file transfers.
-
Enterprise AI Agents for Every Customer MomentFrom chat to voice to SMS, every conversation gets a smart, personalized response powered by your policies, tone, and data.
-
1
Airborne Data Processing and Analysis
Software to processing and analyze of airborne measurements.
The Airborne Data Processing and Analysis (ADPAA) package is an open-source software package containing a collection of programs and scripts to process and analyze data from in-situ instruments deployed on airborne platforms. The ADPAA package was started to process data on the North Dakota Citation Research Aircraft but has been used to process data on many airborne platforms. -
2
Databend
Cloud-native open source data warehouse for analytics and AI queries
Databend is an open source cloud-native data warehouse designed for large-scale analytics and modern data workloads. Built in Rust, the system focuses on high performance, scalability, and efficient data processing for analytical queries. It is designed with a separation of compute and storage, allowing compute nodes to scale independently while storing data in object storage systems. -
3
ChatLab
Local-first AI chat analysis tool for insights from conversation data
...ChatLab emphasizes a local-first approach, meaning all chat data is processed and stored on the user’s device rather than being uploaded to external servers. It supports large-scale datasets through streaming parsing and multi-worker processing, allowing it to handle millions of messages efficiently. ChatLab also includes visualization features that present trends, activity patterns, and interaction metrics in a clear and accessible format. -
4
Robin
AI-powered tool for dark web OSINT search and investigation
...The project provides a modular architecture separating search, scraping, and AI processing components so it can be extended with new data sources. -
Tremendous is the global payouts platform for businesses sending gift cards and money at scale.Trusted by 20,000+ leading organizations, Tremendous has delivered billions of rewards and enables businesses to reach recipients across 230+ countries and regions. Recipients have 2,500+ payout options to choose from, including gift cards, prepaid cards, cash transfers, and charitable donations.
-
5
Open Semantic Search
Open source semantic search and text analytics for large document sets
...It integrates text mining and analytics capabilities that allow users to examine relationships, topics, and structured data within document collections. -
6
Nexent
Zero-code platform for building AI agents from natural language input
...It focuses on a zero-code approach, allowing users to define workflows and agent behavior purely through language prompts, significantly lowering the barrier to entry for AI development. Built on the MCP ecosystem, Nexent integrates a wide range of tools, models, and data sources into a unified environment for agent creation and execution. Nexent supports multi-agent collaboration, enabling multiple intelligent agents to interact and coordinate tasks within complex workflows. It also includes capabilities for data processing, knowledge tracing, and multimodal interaction, allowing agents to work with different input and output formats. ... -
7
watercrawl
AI-ready web crawler that extracts and structures website content
WaterCrawl is an open source web crawling and data extraction platform designed to transform website content into structured data suitable for machine learning and AI workflows. It enables developers and researchers to crawl web pages, extract meaningful information, and convert it into formats that are easier to process and analyze. It provides a modern crawling system that can automatically navigate links, control crawl depth, and collect content from targeted sections of a website.... -
8
Preswald
Python tool for browser-based interactive data apps in one file
Preswald is an open source Python-based framework and static-site generator designed for building interactive data applications that run entirely in the browser. It packages application logic, data processing, and user interface components into a single self-contained output, enabling easy sharing and deployment without requiring local dependencies. Preswald leverages a WebAssembly runtime along with technologies like Pyodide and DuckDB to execute Python code directly in the browser environment. ... -
9
Memobase
Fast backend for long-term AI user memory via structured profiles
Memobase is an open source backend system that enables long-term user memory functionality for AI applications by capturing and structuring information about users across interactions. Its design centers on creating user profiles and recording event timelines, allowing AI systems to remember, understand, and evolve in their behaviour toward individual users over time. Instead of relying purely on traditional embedding-based retrieval or RAG systems, Memobase uses profile and timeline... -
GoAnywhere Managed File Transfer (MFT)GoAnywhere MFT provides secure managed file transfer for enterprises. Deployable on-premise, in the cloud, or in hybrid environments, GoAnywhere MFT software enables organizations to exchange data among employees, customers, and trading partners, as well as between systems, securely. GoAnywhere MFT was a recipient of the Cybersecurity Excellence Award for Secure File Transfer.
-
10
Rivet
Visual AI IDE for building agents with prompt chains and graphs
...Rivet supports multiple large language model providers and integrates with services such as embeddings and transcription systems, allowing developers to create richer AI-powered features. Its architecture emphasizes composability, where different components like prompts, APIs, and data processing steps can be combined into reusable pipelines. -
11
RuoYi AI
Enterprise AI platform for building, deploying, and managing apps
RuoYi AI is a full-stack enterprise-oriented AI development platform designed to help developers rapidly build, deploy, and manage intelligent applications using modern large language models and AI ecosystems. It provides a unified framework for integrating multiple AI models from different providers, allowing teams to switch or combine models through a consistent interface without vendor lock-in. RuoYi AI includes built-in support for retrieval-augmented generation, enabling organizations... -
12
Software tools facilitating the task of surveying architecture (real-time control, parametric modelling, use of digital photographs, processing of point clouds...). Until now, those tools were mainly used to document cultural heritage sites/buildings
-
13
xsd2pgschema
Relational database replication tool based on XML Schema
xsd2pgschema is a Java application suite, which converts XML Schema 1.1 (hierarchical data model) to PostgreSQL DDL (relational data model) and supports XML data migration into PostgreSQL based on the XML Schema without defects on information content. It also supports full-text indexing via either Apache Lucene or Sphinx Search utilizing the relational data model. File conversion from XML to CSV, TSV, or JSON is possible as well as mapping XML Schema to JSON Schema. Obtained PostgreSQL... -
14
Breakpad
Mirror of Google Breakpad project
Breakpad is an open source crash reporting system developed by Google that provides both client and server components to capture, analyze, and report software crashes across platforms. It is designed to help developers diagnose and fix crashes efficiently by generating detailed crash dumps, stack traces, and diagnostic data whenever an application fails unexpectedly. The framework includes libraries for embedding crash-handling functionality directly into applications and tools for processing and symbolizing crash dumps on the server side. Breakpad supports multiple operating systems, including Linux, macOS, and Windows, and integrates easily into existing build systems. ... -
15
UniversalTextExtractor
Command-line toolset for extracting text from files
Command-line toolset for extracting text from files (documents, images, archives) into SQLite with OCR support. Simple, expandable, one shell script only. -
16
MAF
Bash Framework to combine many preprocessing and alignment tools
...The platform enables researcher to apply multiple sequence aligners and further pre- and postprocessing tools in flexible combinations to analyze the subtle to remarkable differences between different sequence alignment and processing algorithms applied to the same data basis. Cite the following publication: https://doi.org/10.3390/mps8030065 -
17
AI File Sorter
Local AI file organization with categorization and rename suggestions
AI File Sorter is a cross-platform desktop application that uses AI (local LLMs run on your computer) to organize files and suggest meaningful file names based on real content, not just filenames or extensions. The app can analyze images locally and propose descriptive rename suggestions (for example, IMG_2048.jpg → clouds_over_lake.jpg). It can also analyze document text to improve categorization and renaming. Supported formats include PDF, DOCX, XLSX, PPTX, ODT, ODS, ODP, and common... -
18
openSkyMatch
Matches OpenScience Observatories images with astronomical catalogs
openSkyMatch is a collection of Linux shell and Python scripts designed for the OpenScience Observatories program. It automates the identification and matching of detected celestial objects in locally captured FITS images with entries in large-scale sky catalogs, notably Pan-STARRS1 DR2 (II/389/ps1_dr2). The toolkit supports data preprocessing, coordinate correlation, and catalog-based validation of astronomical detections. All tools are open-source and optimized for reproducibility and... -
19
Demo Scene
Scripts and samples to support Confluent Demos, Talks, and Blogs
Demo Scene is a collection of resources and examples provided by Confluent Inc. to demonstrate the capabilities of Apache Kafka and its ecosystem. It includes various demos showcasing real-time data streaming, processing, and integration patterns -
20
AICtools
Workflow and set of tools for Automated Imagery Classification
AICtools is a GIS workflow and set of tools to facilitate Automated Imagery Classification (AIC) and analysis of surface features over time. Allows bulk processing of large data sets, including automated metadata processing/filtering, compressed archive extraction and file manipulation, raster band compositing, pre-processing, mosaicking, clipping. Automates a subset of operations involved in classification of satellite imagery and the associated raster calculations used for time trend analysis. -
21
SQLFlow
SQL compiler bridging databases and machine learning workflows
SQLFlow is an open source project designed to bridge the gap between traditional SQL-based data processing and modern machine learning workflows by extending SQL syntax with AI capabilities. It acts as a compiler that translates SQL programs into executable workflows, enabling users to train, evaluate, and deploy machine learning models directly from SQL statements. It integrates with multiple database engines such as MySQL, Hive, and MaxCompute, while also supporting machine learning frameworks like TensorFlow and XGBoost. ... -
22
LaTeX Reference Card Creator
A Makefile based build system for creating LaTeX reference cards
LaTeX Reference Card Creator is a Makefile based build system for creating reference cards. LaTeX Reference Card Creator compiles content into PDF, DjVu, TEX DVI, HTML and PostScript output formats. A three column reference card will be created. Features include batch image format conversions, spell checking, broken link checking, automatic backups and .zip and .tar.gz distribution building. LaTeX Reference Card Creator provides many LaTeX examples which can be used to make a reference card. -
23
Theophanu - Scenebuilding Environment
Controls processing and daylight simulation with hierarchical models.
Theophanu defines the data-structure and the processing logics to control daylight simulations with Radiance on hierarchical models. It was developed together with a detailed simulation model of late antique Hagia Sophia in Istanbul as part of a research project at TU Darmstadt, supported by the DFG German Research Foundation, grant #5194526: "Die Hagia Sophia Justinians in Konstantinopel als Schauplatz weltlicher und geistlicher Inszenierung in der Spätantike" (http://gepris.dfg.de/gepris/projekt/5194526). ... -
24
MultiPathNet
A Torch implementation of the object detection network
MultiPathNet is a Torch-7 implementation of the “A MultiPath Network for Object Detection” paper (BMVC 2016), developed by Facebook AI Research. It extends the Fast R-CNN framework by introducing multiple network “paths” to enhance feature extraction and object recognition robustness. The MultiPath architecture incorporates skip connections and multi-scale processing to capture both fine-grained details and high-level context within a single detection pipeline. This results in improved... -
25
MCCCS
Multi Channel Classification and Clustering
Here we present an image-based Multi Channel Classification and Clustering System (MCCCS). It is an generalized, script-based classification system for processing various kinds of image data. Due to the modular design, individual processing-components can be easily adapted, extended or exchanged by own extensions. See project website for installation instructions.
