Open Science Practices in DATAMITE
Before starting to talk about any subject, it is necessary to define the topic to be addressed. So let's start with the basics: what is open science? It is an approach to the scientific process based on open cooperative work, tools and the dissemination of knowledge. DATAMITE is fully committed to open science practices, following the guidelines set by Horizon Europe. Our approach is based on four key principles that ensure transparency, reproducibility and broad public awareness throughout the research process.
Early and Open Research Exchange
At DATAMITE, we believe that sharing research results and plans early in the process improves the overall quality of the work. By sharing our plans prior to implementation, we ensure a more rigorous and unbiased approach, which reinforces the validity of our output.
Management of Research Results for Reproducibility
We make all data, methods and findings publicly available through open access repositories, allowing others to reproduce and build on our work. To facilitate this, we use standardised frameworks and persistent identifiers (PIDs), which help ensure that our research can be reliably reproduced and reused by the wider scientific community.
Open Access and Peer Review
Open access to research results is another fundamental component of DATAMITE's approach. We adhere to EU regulations on open access and open science, making our work accessible to the widest possible audience. We use two strategies to achieve the highest possible impact: Green Open Access (self-archiving in open repositories) and Gold Open Access (publication in open access journals). By contributing to the European Open Science Cloud (EOSC), we help make data and research results easily discoverable, sharable and interoperable across platforms and disciplines.
Stakeholder Involvement and Citizen Science
Public and stakeholder participation plays a vital role in DATAMITE's success. This inclusive approach not only increases the relevance and effectiveness of our work, but also enhances creativity and transparency. By collaborating with policy makers, businesses and citizens, we ensure that our research is aligned with society's needs and values, while expanding the scope and quality of our data.
Additional Efforts to Guarantee Open Science
In addition to the key principles described above, DATAMITE uses online repositories to manage and publish research materials, making them available with different access permissions. We rely on platforms such as Zenodo, which is part of the EOSC, to deposit both publications and datasets. We also encourage the use of Open Research Europe, a platform that offers open access publishing without author fees, ensuring that our research remains accessible and compliant with open access standards. Wherever possible, we make our datasets publicly available through the official EU data portal.
Finally, DATAMITE also takes great care to adhere to Open Science standards. We ensure that all peer-reviewed publications are deposited in trusted repositories under Creative Commons licences, providing immediate open access. Each publication is accompanied by detailed metadata, ensuring compliance with FAIR principles and making our research fully transparent and accessible to others.
If you want to always stay updated about our project, follow us on Twitter and LinkedIn!
Meet the people behind DATAMITE: Mariano Blaya Andreu (IDSA)
DATAMITE is an ambitious project with a consortium of 26 organisations from 11 countries, but beyond the numbers are the people. With the series “Meet the people behind DATAMITE” we want to introduce the people who work every day to achieve our ambitious goal: to deliver a modular, open-source and multi-domain Framework to improve data monetising, interoperability, trading and exchange in the form of software modules, training and business materials for European companies, empowering them to become new relevant players in the data economy.
Today we present Mariano Blaya Andreu, Director of Delivery at International Data Spaces Association (IDSA). "At the beginning of the DATAMITE project I helped/led the preparation of, what we call, the state-of-the-art involving the data spaces and the building blocks, also using the knowledge coming from IDSA, but also from Data Spaces Support Centre (DSSC)", he explains.
When asked what makes DATAMITE special, Mariano states that " the DATAMITE framework is going to play a critical role on helping the participants from the different aspects: from the quality point of view, from the monetization point of view, and from the connectivity. The DATAMITE framework is going to ease the onboarding and the connection of different sectors".
Watch the full interview with Mariano Blaya Andreu below or here.
Use Case: Offering Data to Service Providers with DataSpaces
“The smart use of data can have a transformative effect on all sectors of the economy”, states the European Commission in the Building a data economy – Brochure. That is why the European Commission has set out the European Data Strategy. A roadmap to make the EU a leader in the new data-driven society, with the creation of common and interoperable data spaces. Facilitating the deployment and smooth functioning of European Common Data Spaces is one of the key objectives of DATAMITE. Both through its innovative modular, open source and multi-domain framework to improve, among other things, data exchange; and through the different pilots in which this framework will be developed, tested and validated.
In Pilot 3, HEDNO’s aim is twofold: firstly, to embark on a journey to revolutionize its internal data management practices, and secondly, by embracing the concept of Data Spaces, to facilitate data exchange with its valued providers. This initiative underscores HEDNO's commitment to fostering a data-driven culture and optimizing operational efficiency. Central to this endeavor is the validation of robust data governance and quality tools, ensuring that data remains accurate, reliable, and compliant throughout its lifecycle.
Offering Data to Service Providers through Energy DataSpaces Use Case: a unique opportunity to test the DATAMITE framework
To be able to measure the value offered by the DATAMITE framework it is ideal to be tested over an actual use case that consists of data sharing to DataSpaces and will be validated by publishing data in Energy DataSpaces like, potentially, those provided by DATA CELLAR.
Currently, HEDNO ensures the availability and statistical analysis of metering data while safeguarding consumers' personal information. Using Advanced Metering Infrastructure (AMI) and Meter Data Management (MDM) systems, HEDNO collects energy measurements. However, sharing data with service providers remains a manual and complex process. Automation necessitates improving data discovery and management, standardizing data formats, ensuring compliance with laws and regulations, and establishing data access control policies. This lack of automation complicates data sharing and limits monetization or collaboration opportunities such as the exploitation or engagement of data markets or data spaces.
The DATAMITE framework: a vital component for data sharing though DataSpaces
DATAMITE will facilitate the automation of data sharing through its different modules. First, with Governance tools, facilitating Findability, Accessibility and Interoperability to data, allowing the definition of new vocabularies or adoption of existing ones to better tag its data. Second, the Quality Module will ensure that data meets sufficient quality criteria to be shared with third parties. Third, with Security tools, defining fine-grained access and authorization policies, and facilitating anonymization, privacy preservation or encryption processes. Fourth, with the Data Sovereignty component and IDSA components, e.g., EDC connector, integrated in the sharing module, allows the definition and enforcement of precise terms of use as well as sharing them to IDSA compliant DataSpaces.
Impacts beyond the use-case scenario
The developed pilot adopts a modular architecture featuring DATAMITE modules, aiming to combine artifacts from various energy data sources into datasets and converting them to cohesive data products. Through data spaces, this aggregated data will be shared with service providers, facilitating monetization or reciprocal service exchange.
Aligned with the project vision, the pilot endeavors to enhance data sharing processes through DATAMITE modules. Governance tools enhance data accessibility, while security measures ensure data integrity and sovereignty. Leveraging data spaces, stakeholders can effectively utilize energy data for various purposes fostering collaboration within the energy ecosystem. Moreover, our pilot’s architecture could find application and be extended to other domains.
If you want to always stay updated about our project, follow us on Twitter and LinkedIn!
Meet the people behind DATAMITE: Marko Turpeinen (1001 Lakes)
DATAMITE is an ambitious project with a consortium of 26 organisations from 11 countries, but beyond the numbers are the people. With the series “Meet the people behind DATAMITE” we want to introduce the people who work every day to achieve our ambitious goal: to deliver a modular, open-source and multi-domain Framework to improve data monetising, interoperability, trading and exchange in the form of software modules, training and business materials for European companies, empowering them to become new relevant players in the data economy.
Today we present MarkoTurpeinen, CEO at 1001 Lakes. In DATAMITE their role is "to be experts both in the technology side, especially regarding data quality and data usage control, and then also in the business legal and ethical questions that have to do with data monetization", he explains.
When asked what makes DATAMITE special, Marko stresses that "the way DATAMITE combines technical, business, governance and legal issues is actually quite unique".
Watch the full interview with Marko Turpeinen below or here.
If you want to always stay updated about our project, follow us on Twitter and LinkedIn!
Meet the people behind DATAMITE: Ricardo Almeida Henriques (E-REDES)
DATAMITE is an ambitious project with a consortium of 26 organisations from 11 countries, but beyond the numbers are the people. With the series "Meet the people behind DATAMITE" we want to introduce the people who work every day to achieve our ambitious goal: to deliver a modular, open-source and multi-domain Framework to improve data monetising, interoperability, trading and exchange in the form of software modules, training and business materials for European companies, empowering them to become new relevant players in the data economy.
Today we present Ricardo Almeida Henriques from E-REDES –the Portuguese main electricity distribution system operator. His role within DATAMITE is “to coordinate and contribute to the E-REDES pilot which we called ‘leverage electricity distribution open data’. In 2022 we have launched an open data portal which contains different types of datasets related to electricity distribution activity, and it's targeted to different types of stakeholders as well, such as universities, research institutes, municipalities and also consumers”. He explains.
When asked what makes DATAMITE special, Ricardo believes that “DATAMITE is a very ambitious project because it will cover aspects from the creation of the data, to data sharing with data spaces, and data monetization. And the technical developments of the project will significant contribute to energy sector stakeholders”.
Watch the full interview with Ricardo Almeida Henriques below.
Meet the people behind DATAMITE: Samarkhel-Khan Yahya (DIN)
DATAMITE is an ambitious project with a consortium of 26 organisations from 11 countries, but beyond the numbers are the people. With the series "Meet the people behind DATAMITE" we want to introduce the people who work every day to achieve our ambitious goal: to deliver a modular, open-source and multi-domain Framework to improve data monetising, interoperability, trading and exchange in the form of software modules, training and business materials for European companies, empowering them to become new relevant players in the data economy.
Today we present Samarkhel-Khan Yahya from DIN – the German Institute for Standardization. He studied Computer Science and Business Engineering in the field of project management, and since 2016, he works at DIN within the team responsible for the committee “Information Technology and selected IT Applications (NIA)”. In this committee, there are several subcommittees that deal with Information Technology topics like e.g. Artificial Intelligence, IT-Security, Internet of things, Biometrics etc, he explains. “I am responsible for standards in the field of Cards and security devices for personal identification and manage national committees at DIN, but also international committees at ISO, as DIN is also a member of the European and International Standardization Organizations CEN and ISO”.
What is your role in the DATAMITE project?
In DATAMITE my role is to observe the project results and discuss standardization potential, as I am responsible for standardization in the project. If we identify standardization gaps in the project, then it is possible to develop new standards within DATAMITE.
Standardisation has different effects on the innovation process, such as promoting the transfer of knowledge and technology from research results to practice and the market, helping to disseminate and apply innovative knowledge, identifying the demand for technical standards, networking with relevant actors in the field, or strengthening and improving the overall competitiveness of the national economy.
What milestones do you expect to achieve at the project?
I expect that we can develop a CEN Workshop Agreement (CWA). A CWA is intended to satisfy market demands for a more flexible and timelier alternative to the traditional European Standard. So, basically a CWA is the ideal solution, when you have innovations and want to develop a document quickly, without the usual standardization process, which can take 3 years. A CWA can be developed in one year and does not reflect the same level of consensus like a European Standard, which is why it can be developed quicker. This CWA however can be transformed into a European Standard in the future. So, there is no need to rush things into a European Standard, when you are dealing with innovative solutions.
In your opinion, what is the positive impact that DATAMITE will generate? What is the element that makes this project special?
I think that in this digital era, data is becoming more important than ever. I hope that the DATAMITE framework will help European companies to exploit and monetize their data and monetize it. I think that otherwise lots of potential will be left off. I expect that the DATAMITE project can make that difference in the European market.
If you want to always stay updated about our project, follow us on Twitter and LinkedIn!
Time flies: a year of DATAMITE as seen from every WP
DATAMITE is a project that embodies the values of teamwork and diversity, with a team characterised by multidisciplinarity, complementarity of knowledge and objectives, and an excellent track record in research and development projects. To achieve DATAMITE's ultimate goal of delivering a modular, open source, multi-domain framework to improve data monetising, interoperability, trading and exchange, the different partners of the consortium are organised under Work Packages (WP), forming a total of 7.
In this article the leaders of each Work Package review the first year of DATAMITE (2023) and what they hope to achieve in the next year (2024), within their area of work and objectives.
WP1: Datamite Design, development and preparation
During the first year of the project the work of WP1 focused on preparing and successfully submitting two deliverables. D1.1 Roadmap and Pilots Definition contains contributions regarding the project roadmap, pilots design, KPI and data quality metrics definition, state of the art analysis and integration roadmap of ICT-13 building blocks. D1.2 Requirements and Architecture describes the project requirements collection and analysis, and the design of the DATAMITE framework and modular architecture. Those two deliverable contain contributions gathered in all WP1 tasks: three of them (T1.1, T1.2 and T1.4) are already completed, while the other two (T1.3 and T1.5) are frozen until the next WP1 deliverable (D1.3) will be due in M20.
In 2024, WP1 will focus on the remaining open tasks: validating and updating the requirements of the project, and updating the architecture according to the work done in technical work packages. Those contributions will be gathered in D1.3 Requirements and Architecture, which will be an update of D1.2.
WP2: Data Sharing Mechanisms and data sovereignty
In the past year, WP2 has been dedicated to conducting research on DATAMITE data sharing mechanisms and data sovereignty aspects. In more detail, we explored initiatives from IDSA & GAIA-X components and established communication channels with potential data destinations such as DATA CELLAR, AIoD, and EOSC. These efforts aimed to gather insights into data sharing and data sovereignty, encompassing aspects like data and metadata management, and access control policies. As a result, we have formulated the initial design approach for both data sharing and data sovereignty mechanisms.
Looking ahead to the upcoming year, our focus will shift toward developing data sharing mechanisms and data sovereignty tools, integrating them with a variety of data destinations.
WP3: Data governance, quality, security and support modules
Work Package 3 has played a pivotal role during its initial year, focusing on delivering to the DATAMITE modules for Data Governance, Quality, Security, and Support tools. Throughout this pre-eminently technical package, our efforts have centered on contributing to the framework architecture aligning with stakeholder requirements, designing key components, and evaluating existing ones for integration. Simultaneously, progress has been made in developing user interfaces. A noteworthy accomplishment within this work package is the delivery of a comprehensive analysis, presented in D3.1, shedding light on the intricate process of constructing a data product. From the ingestion of raw data to the addition of informative metadata, quality enhancement, and policy integration for third-party use, our approach also considers the profound impact of GDPR on handling personal data.
WP4: Beyond sharing A business and quality approach to Foster the European Data Economy
In the past year, Work Package 4 (WP4) has been instrumental in integrating the business model perspective into platform development. The focus was primarily on examining the legal aspects of data sharing, and initial strategies for data monetization were formulated. The understanding of the business model and the importance of considering customer interests are continuously being woven into the project's core. Moreover, we have begun exploring the initial benefits of data monetization that extend beyond mere economic value.
Looking ahead to the upcoming project year in 2024, our efforts will be expanded to provide companies with a comprehensive guide for selecting their data monetization strategies. Moreover will we pursue the development of mechanisms for quantifying the value of data and a maturity model for competency development in implementing data monetization strategies. The aim is to offer a structured approach that not only maximises economic returns but also considers broader benefits arising from data utilisation.
WP5: Integration, Demonstration and Validation
During the first year, six use case demonstrators have been developed on top of the DATAMITE framework within the WP5, validating it and proving its usefulness in real life/realistic scenarios. During the first period the use cases have been elaborated in more details, providing also requirements for the DATAMITE architecture. Detailed architecture for each use case has been defined, using the DATAMITE architecture as the base for defining the use case specific building blocks and flows. As part of the initial steps the pilot input datasets have been defined and validated.
Early 2024, WP5 will start setting up and maintaining the continuous integration tools and processes that will support and guide the integration and release of the DATAMITE framework. In 2024 pilots will start development of pilot-specific connectors/modules needed to deploy the DATAMITE Framework.
WP6: Outreach, Exploitation and Collaboration
Looking back on the past year, Work Package 6 has been a pivotal force in our project's success. It spearheaded communication and dissemination efforts, creating impactful outreach materials and supporting participation in key international events like Data Week 2023, EGI –Enabling Grids for E-Science- Conference, the European Big Data Value Forum or EclipseCon, and important national events such as Women in Tech Summit, ITM Industry Europe or the National Field Days. In addition, WP6 has been in charge of the design, development and daily maintenance of DATAMITE's social media, a fundamental tool to create a community around the project and to make its progress known to a wide audience beyond the Consortium partners. One of the most outstanding actions is the campaign "meet the people behind DATAMITE", which combines articles on the website, interviews uploaded to YouTube and a campaign on Linkedin and Twitter to get to know the professionals working on the project in a closer way.
WP6 implemented an effective Impact Master Plan, organising an internal workshop to define the exploitable results as well Preparation of standardisation research which will lead to proactive involvement in relevant standardisation committees and ongoing projects. Collaborating with the Data Spaces Support Center, we conducted regular meetings and actively engaged in all three thematic areas. These discussions helped identify needs for the Data Spaces Connector's development, addressing technical challenges collaboratively. In the ecosystem development sphere, we successfully introduced a GitHub repository for our project, fostering transparency and collaboration within our community. These activities have strengthened our project's standing, propelling us toward excellence.
Looking ahead to 2024, WP6 is committed to deepening our involvement in ecosystem development and community engagement and outreach activities. The successes of the past year and the connections forged through events and campaigns fuel our anticipation for continued growth, collaboration, and innovation. Here's to a year of achievements and the promising endeavours that lie ahead!
WP7: Project Management
The main goal of project management (WP7) during the first year was to provide a focused, lean, but effective framework to support the partnership in achieving the project's scientific, technical and business objectives. WP7 has established the project governance structure appropriate for the project to run successfully. A set of collaborative tools, e.g, SharePoint server and mailing lists, among others, have been implemented to effectively collaborate in a large project like DATAMITE with 25 organisations. Furthermore, reporting procedures, including the Deliverable 7.1 Project Management, Risk and Quality Handbook, have been established to ensure everything is consistent with what was expected in the Grant Agreement. Quality Management has also been considered to meet high expectations, and risks are continuously identified and monitored to apply countermeasures as soon as they are realised. Lastly, the project keeps up to date with a data management and protection plan that all partners follow.
If you want to always stay updated about our project, follow us on Twitter and LinkedIn!
Meet the people behind DATAMITE: Vasso Apostolopoulou (OTE)
DATAMITE is an ambitious project with a consortium of 26 organisations from 11 countries, but beyond the numbers are the people. With the series "Meet the people behind DATAMITE" we want to introduce the people who work every day to achieve our ambitious goal: to deliver a modular, open-source and multi-domain Framework to improve data monetising, interoperability, trading and exchange in the form of software modules, training and business materials for European companies, empowering them to become new relevant players in the data economy.
Today we present Vasso Apostolopoulou from OTE Group of Companies. She describes herself as “a dedicated professional with a strong commitment to personal growth and continuous learning, particularly in the fields of business administration and data analytics”. As an Innovation Engineer at OTE, her role involves evaluating and testing emerging technologies to align them with OTE's business needs. “Within the IT Innovation Center, we collaborate with various departments, prioritize innovation, and lead projects to integrate new solutions, driving positive change”.
As part of the DATAMITE Consortium, Vasso aims to expand her knowledge “at the intersection of data and monetization, while actively participating in the evolving data-driven era”. When asked about her motivations as a professional, she is clear: “What truly inspires me is the opportunity to contribute to my field by constantly seeking ways to add value through improvement and innovation”. A philosophy that we fully share at DATAMITE as a project.
Watch the full interview with Vasso Apostolopoulou below.
If you want to always stay updated about our project, follow us on Twitter and LinkedIn!
Meet the people behind DATAMITE: Santiago Cáceres (ITI)
DATAMITE is an ambitious project with a consortium of 26 organisations from 11 countries, but beyond the numbers are the people. With the series "Meet the people behind DATAMITE" we want to introduce the people who work every day to achieve our ambitious goal: to deliver a modular, open-source and multi-domain Framework to improve data monetising, interoperability, trading and exchange in the form of software modules, training and business materials for European companies, empowering them to become new relevant players in the data economy.
Today we present Santiago Cáceres from ITI (Instituto Tecnológoco de Informática) and DATAMITE Project Coordinator. “I have been working in European research funding based projects for around 14 years, and my current interests are around the data cycle, from its generation to its exploitation and going through the transformation, artificial intelligence techniques, and so on”, he explains.
When asked what makes DATAMITE special, Santiago Cáceres is clear: “We believe that at the end the framework that we are developing is not going to stand there only for the companies that are within the project but to the outside community, to the European dimension out of it”.
Watch the full interview with Santiago Cáceres below.
DATAMITE and the development of common EU data spaces
In an increasingly digital world, more and more data are being generated, making it an increasingly essential asset for both social and economic benefit. “The smart use of data can have a transformative effect on all sectors of the economy and can create new opportunities for economic growth, including for small and medium-sized enterprises”, states the European Commission in the Building a data economy - Brochure. This is why the European Commission has established the European data strategy. A roadmap to make the EU leader in this new data-driven society, creating a single market for data to pool European data in key sectors, with common and interoperable data spaces. One of DATAMITE's objectives is to support the deployment of these Common European Data Spaces, thanks to its relevant partners in the International Data Spaces (IDS) ecosystem.
The Importance of common European data spaces
As said before, practically every scenario of today's life produces data. This makes it important to create infrastructures where data generated by individuals, companies or public organisations can be collected and shared easily, securely and ensuring the quality of the processed data. According to the Staff working document on data spaces, the Common European data spaces aim to:
- Deploy data-sharing tools and services for the pooling, processing and sharing of data by an open number of organisations.
- Include data governance structures, compatible with relevant EU legislation, which determine, in a transparent and fair way, the rights concerning access to and processing of the data.
- Improve the availability, quality and interoperability of data – both in domain-specific settings and across sectors.
DATAMITE, an ally for the implementation of common European data spaces
DATAMITE is part of the Horizon Europe programme efforts to support research and innovation in new technologies underpinning the data economy. Not surprisingly, its main objective is to provide a modular, open source, multi-domain framework for improved monetisation, interoperability, commerce, and data exchange.
To be able to reach this goal, DATAMITE addresses the challenge of the lack of trusted and secure platforms for data sharing. It aims to establish trust in data sharing by leveraging the experience of initiatives like IDS and Gaia-X. To ensure that the project results are adapted to possible new tools or technologies that may appear throughout the life of DATAMITE, the consortium includes several partners, such as IDSA, Fraunhofer and TECNALIA, that ensure awareness of the initiatives evolution and collaborate with them.
Use Cases to prove data sharing in data spaces
DATAMITE proposes three different Use Cases with two pilot scenarios each. These Use Cases focus on data exchange within large corporations, energy data spaces, and interaction with other initiatives. Each use case leverages various components of DATAMITE to improve data governance, quality, and security.
After testing DATAMITE in these six pilots, the project aims to enhance data sharing through its modules, focusing on governance, quality, security, and data sovereignty. It provides tools for interoperability and facilitates data sharing in data spaces. Additionally, DATAMITE offers a technological stack to ease data management and sharing, particularly in data spaces, contributing to improving the interoperability of data providers.
“The creation of EU-wide common, interoperable data spaces will overcome existing legal and technical barriers to data sharing and, as such, unleash the enormous potential of data-driven innovation”, affirms the European Commission. DATAMITE not only agrees but a large part of the workload of the project is aimed at facilitating the exchange of data between users. And, therefore, to contribute to the long-awaited creation of common European Data Spaces that provide new and better data-driven business models, positioning the European economy as a leader in the sector.
If you want to always stay updated about our project, follow us on Twitter and LinkedIn!