https://neardata.eu

NearDataSite descriptionNearData Menu Objectives Use Cases Results News Partners About NearData Extreme Near-Data Processing Platform Learn More Objectives The goal of NEARDATA is to create an extreme data infrastructure mediating data flows between Object Storage and Data Analytics platforms across the Compute Continuum. Our novel XtremeDataHub platform is an intermediary data service that intercepts and optimises data flows (S3 API, stream APIs) with highperformance near-data connectors (Cloud/Edge). Finally, our unique Data Broker service will provide secure data access and orchestration of dispersed data sources thanks to TEEs and federated learning architectures. Our NEARDATA platform is a novel technology for data mining of large and dispersed unstructured data sets that can be deployed in the Cloud and in the Edge (HPC, IoT Devices), that leverages advanced AI technologies and offers a novel confidential cybersecurity layer for trusted data computation. The goals of NearData are the following: Provide high-performance near-data processing for Extreme Data Types: The first objective is to create a novel intermediary data service (XtremeDataHub) providing serverless data connectors that optimize data management operations (partitioning, filtering, transformation, aggregation) and interactive queries (search, discovery, matching, multi-object queries) to efficiently present data to analytics platforms. Our data connectors facilitate a elas- tic data-driven process-then-compute paradigm which significantly reduces data communication on the data interconnect, ultimately resulting in higher overall data throughput. Support real-time video streams but also event streams that must be ingested and processed very fast to Object Storage: The second objective is to seamlessly combine streaming and batch data processing for analytics. To this end, we will develop stream data connectors deployed as stream operators offering very fast stateful computations over low-latency event and video streams. The third objective is to create a Data Broker service enabling trustworthy data sharing and confidential orchestration of data pipelines across the Compute Continuum. We will provide secure data orchestration, transfer, processing and access thanks to Trusted Execution Environments (TEEs) and federated learning architectures. Use Cases Genomics Creation of methods, fast storage, and communications infrastructures to communicate distributed computing power with scalable storage systems, allowing efficient distribution of datasets across the system. Metabolomics Expand the analysis of metabolomics raw data and boost external access and efficient re-use of open data. Creation of federated and Hybrid distributed architecture and ensuring data privacy but also shared global computations. Surgery Create generalised machine-learning models that can aid surgeons during surgery and allow video data to be analysed in real-time and with low latency. Learn more about the use cases Deliverables Deliverable 1.1 Public Project Website PDF Deliverable 1.3 Data Management Plan PDF Deliverable 2.1 Initial Architecture Specifications PDF Deliverable 2.2 NEARDATA Architecture Specs and Early Prototypes PDF Deliverable 3.1 XtremeHub first release and documentation PDF Deliverable 4.1 Data Broker release and documentation PDF Deliverable 5.1 First release of KPI benchmarks in all use cases and data connector libraries PDF Deliverable 6.1 Communication plan PDF Deliverable 6.2 Communication and standardization report PDF * Deliverables pending approval Publications Software results See list of publications See software results NEARDATA Kick-off meeting February 1st, 2023 On 1 February, the members of the project participated in the kick-off – the first joint meeting – held at the Universitat Rovira i Virgili. Close news Cloud-Edge Continuum (CEC’23) October 10th, 2023 Cloud-Edge Continuum workshop (CEC’23) will be held in Reykjavik on October 10, 2023 and is organized and co-located with IEEE ICNP conference that will take place on October 10-13. CEC’23 is supported by multiple consortia of leading academic and industry organizations, funded by EU commission. MORE INFORMATION Close news European Big Data Value Forum (EBDVF 2023) October 25-27, 2023 The European Big Data Value Forum (EBDVF 2023) took place on 25-27 October 2023 in Valencia, Spain and counted with +400 speakers. It was a good opportunity for networking and let important players (Siemens, Amazon, IDC, to name a few11) in the big data market to learn about NEARDATA. One particular outcome from attending this event was establishing new links with HPC and companies players around opportunities to the upcoming calls on Digital Twins for Destination Earth MORE INFORMATION Close news Middleware 2023 Desembre 11-15, 2023 NEARDATA preseted some of its works in 24th ACM/IFIP International Middleware Conference, an annual conference and a major forum for the discussion of innovations and recent scientific advances of middleware systems with a focus on the design, implementation, deployment, and evaluation of distributed systems, platforms and architectures for computing, storage, and communication. MORE INFORMATION Close news M12 NEARDATA Meeting February 22-23, 2024 NEARDATA partners gathered in Barcelona at BSC headquarters to present their progress and align expectations and lay down next steps. The NEARDATA promotional video was first introduced in this meeting. SEE VIDEO Close news Mobile World Congress 2024 (MWC24) February 26-29, 2024 An important event where NEARDATA was presented is the Mobile World Congress 2024 (MWC24), one of the major international industrial events, that took place between 26th and 29th of February 2024 in Barcelona, Spain. Two partners, BSC and DELL, had a booth where the NEARDATA project was disseminated. According to the event organization: MWC convened over 88,500 attendees from 202 countries and territories, including policymakers and business leaders from the mobile ecosystem and beyond. MORE INFORMATION Close news International Symposium on Cluster, Cloud and Internet Computing May 8th, 2024 NEARDATA presented some of its works in the 24th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID 2024), a leading forum for disseminating and discussing research activities and results on a broad range of topics in distributed systems, ranging from computing Clusters to widely distributed clouds and emerging Internet computing paradigms, such as fog/edge computing for Internet of Things (IoT)/big data applications. MORE INFORMATION Close news Cloud-Edge Continuum (CEC’24) October 28th, 2024 Cloud-Edge Continuum workshop (CEC’24) will be held in Charleroi on October 28, 2024 and is organized and co-located with IEEE ICNP conference that will take place on October 28-31. CEC’24 is supported by multiple consortia of leading academic and industry organizations, funded by EU commission. MORE INFORMATION Close news European Big Data Value Forum (EBDVF 2024) October 2nd, 2024 The European Big Data Value Forum (EBDVF 2024) will be held in Budapest, Hungary, from October 2-4, 2024. NEARDATA will participate with a booth and a joint session alongside other projects from the DataNexus cluster. Join our session on 2 Oct at 14h in the Gold Room to hear about the “Innovative Approaches to Extreme Data Challenges” offered by our DataNexus cluster where Dr. Pedro Garcia Lopez, NEARDATA coordinator, will introduce the NEARDATA project. MORE INFORMATION Close news News NEARDATA Kick-off meeting Consortium meeting Cloud-Edge Continuum (CEC’23) Workshop European Big Data Value Forum (EBDVF 2023) Forum ACM/IFIP Middleware 2023 Conference M12 NEARDATA Meeting Consortium meeting Mobile World Congress 2024 (MWC24) Congress International Symposium on Cluster, Cloud and Internet Computing Symposium Cloud-Edge Continuum (CEC’24) Workshop Participation in the European Big Data Value Forum (EBDVF 2024) Forum NEARDATA Kick-off meeting February 1st, 2023 On 1 February, the members of the project participated in the kick-off – the first joint meeting – held at the Universitat Rovira i Virgili. Close news Cloud-Edge Continuum (CEC’23) October 10th, 2023 Cloud-Edge Continuum workshop (CEC’23) will be held in Reykjavik on October 10, 2023 and is organized and co-located with IEEE ICNP conference that will take place on October 10-13. CEC’23 is supported by multiple consortia of leading academic and industry organizations, funded by EU commission. MORE INFORMATION Close news European Big Data Value Forum (EBDVF 2023) October 25-27, 2023 The European Big Data Value Forum (EBDVF 2023) took place on 25-27 October 2023 in Valencia, Spain and counted with +400 speakers. It was a good opportunity for networking and let important players (Siemens, Amazon, IDC, to name a few11) in the big data market to learn about NEARDATA. One particular outcome from attending this event was establishing new links with HPC and companies players around opportunities to the upcoming calls on Digital Twins for Destination Earth MORE INFORMATION Close news Middleware 2023 Desembre 11-15, 2023 NEARDATA preseted some of its works in 24th ACM/IFIP International Middleware Conference, an annual conference and a major forum for the discussion of innovations and recent scientific advances of middleware systems with a focus on the design, implementation, deployment, and evaluation of distributed systems, platforms and architectures for computing, storage, and communication. MORE INFORMATION Close news M12 NEARDATA Meeting February 22-23, 2024 NEARDATA partners gathered in Barcelona at BSC headquarters to present their progress and align expectations and lay down next steps. The NEARDATA promotional video was first introduced in this meeting. SEE VIDEO Close news Mobile World Congress 2024 (MWC24) February 26-29, 2024 An important event where NEARDATA was presented is the Mobile World Congress 2024 (MWC24), one of the major international industrial events, that took place between 26th and 29th of February 2024 in Barcelona, Spain. Two partners, BSC and DELL, had a booth where the NEARDATA project was disseminated. According to the event organization: MWC convened over 88,500 attendees from 202 countries and territories, including policymakers and business leaders from the mobile ecosystem and beyond. MORE INFORMATION Close news International Symposium on Cluster, Cloud and Internet Computing May 8th, 2024 NEARDATA presented some of its works in the 24th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID 2024), a leading forum for disseminating and discussing research activities and results on a broad range of topics in distributed systems, ranging from computing Clusters to widely distributed clouds and emerging Internet computing paradigms, such as fog/edge computing for Internet of Things (IoT)/big data applications. MORE INFORMATION Close news Cloud-Edge Continuum (CEC’24) October 28th, 2024 Cloud-Edge Continuum workshop (CEC’24) will be held in Charleroi on October 28, 2024 and is organized and co-located with IEEE ICNP conference that will take place on October 28-31. CEC’24 is supported by multiple consortia of leading academic and industry organizations, funded by EU commission. MORE INFORMATION Close news European Big Data Value Forum (EBDVF 2024) October 2nd, 2024 The European Big Data Value Forum (EBDVF 2024) will be held in Budapest, Hungary, from October 2-4, 2024. NEARDATA will participate with a booth and a joint session alongside other projects from the DataNexus cluster. Join our session on 2 Oct at 14h in the Gold Room to hear about the “Innovative Approaches to Extreme Data Challenges” offered by our DataNexus cluster where Dr. Pedro Garcia Lopez, NEARDATA coordinator, will introduce the NEARDATA project. MORE INFORMATION Close news Partners The NEARDATA consortium is a well-balanced team of industrial and academic partners About Project title Neardata: Extreme Near-Data Processing Platform Grant agreement ID 101092644 Coordinator Dr. Pedro García López Partners Universitat Rovira i Virgili (Spain) Barcelona Supercomputing Center (Spain) Technische Universität Dresden (Germany) Deutsches Krebsforschungszentrum Heidelberg (Germany) European Molecular Biology Laboratory (Germany) EMC Information Systems International Unlimited Company (Ireland) KIO Networks España SA (Spain) Sano - Centrum Zindywidualizowanej Medycyny Obliczeniowej (Poland) Scontain GMBH (Germany) UK Health Security Agency (United Kingdom) Duration 01 Jan 2023 - 31 Dec 2025 Overall budget 3,913,585.00€ Programme Horizon >     WORLD LEADING DATA AND COMPUTING TECHNOLOGIES 2022 (HORIZON-CL4-2022-DATA-01) Topic HORIZON-CL4-2022-DATA-01-05 Funding scheme HORIZON-RIA HORIZON Research and Innovation Actions Dissemination materials Brochure - Video NEARDATA project is part of: Contact us Project Coordinator Dr. Pedro García López pedro.garcia@urv.cat Keep in touch NEARDATA has received funding from the European Union’s Horizon research and innovation programme under grant agreement No 101092644. Copyright © NearData 2024 Credits to Agency Jekyll themeenen1729962421https://neardata.eu

Sahypaňyzy redaktirläňmi?

Näme edýärsiň?