Difference between revisions of "Second phase"

From DE4A
Jump to navigation Jump to search
Line 1: Line 1:
This pages serves for preparation of the 2nd phase of the BB assessment.
+
== Building Block Assessment - 2nd Phase ==
 +
The second phase of the assessment of the architecture building blocks (BBs) used in the DE4A project comes after the cataloging of an initial set of relevant BBs for the Project Start Architecture (PSA). While in the previous phase the BBs were assessed for their technical, administrative and operational maturity, in this phase a more constrained set of BBs actually implemented by the pilots was evaluated from a wider perspective.
  
=== Why ===
+
== Methodology ==
Learn from DE4A real world experience applying BBs.
+
The methodology for evaluation was designed following general systemic principles, with a set of indicators including: usability, openness, maturity, interoperability, etc. The identification of the evaluation criteria and the analysis of the results have been approached from several perspectives: literature survey and thorough desktop research; revision and fine-tuning of the initial BB set and evaluation methodology, and an online questionnaire designed for gathering feedback by the relevant project partners:
  
=== Who ===
+
-      Member States (MSs)
People participating in the BB assessment:
 
* WP leaders/task leaders
 
* Pilot leaders/architects
 
* Domain experts in the different WPs
 
  
=== What ===
+
-      WP4 partners - Pilots (Doing Business Abroad - DBA, Moving Abroad - MA, and Studying Abroad - SA)
Assess the Solution Building Blocks (SBBs) used in DE4A Pilots.
 
  
Also includes 2nd iteration Pilots.
+
-      WP5 partners - for specific components
  
Also include new "BBs" like Connector, mockDE/DO, playground, others TBD?
 
  
Take the list of BBs from the first preliminary assessment.
+
To revise and fine-tune the evaluation methodology developed in the first phase, as well as the set of BBs selected for assessment as a result, several meetings and consultations were held with the aforementioned project partners. This led to a narrower set of relevant BBs consisting of a subset of the ones assessed in the first phase, and news ones resulting from the piloting needs and implementation. To capture these specificities, a wide set of questions from the survey capture all aspects important for the decisions made and for future reuse. Several iterations over the initial set of questions were performed, determining the relevance according to the roles of the project partners that provided feedback. Finally, a process of feedback coordination was also determined for the pilot leaders, who gathered additional information by the pilot partners’ implementation of some of the BBs (or important aspects of them).
  
Select only those BBs that where used in DE4A.
+
It is important to note that the division of partners according to their role in the project was done due to the difference in the set of BBs that they had experience with. This implies that not each partner evaluated the whole set of BBs, but only the BBs relevant for their practice and research in the DE4A project.
  
Add possible missing BBs, i.e. BBs used by the technical WPs that are not on the list.
+
The final set of relevant BBs per partner type is given in Table 1, together with statistics on the number of assessments obtained for each BB.
  
*
+
{| class="wikitable"
 
+
|+Table 1 List of building blocks evaluated in the second phase, per relevant partner
=== How ===
+
|'''#'''
See [https://wiki.de4a.eu/index.php/Building_Blocks BB 1st phase], are we doing this?
+
|'''Building Block'''
 
+
|'''# of assessments on the BB'''
For this set of BBs a questionnaire/survey can be completed.
+
|'''Relevant partner(s)'''
 
+
|-
==== indicators ====
+
|
Possible indicators for the questionnaire:
+
|'''Common Components'''
* interoperability (4 dimensions --> EIF/EIRA): assess interoperability of the 4 dimensions
+
|
*# organizational
+
|
*# legal
+
|-
*# semantic
+
| '''1'''
*# technical
+
|eDelivery (data exchange)
* maturity on context of DE4A:
+
|3
 
+
|WP5/MSs
# Technical
+
|-
# Administrative
+
| '''2'''
# Operational
+
|SMP/SML
* openness? CAMMS? -> WP6 (WP1/2 can reuse) TODO discuss with Fredrik way forward
+
|2
* classification BB? Maybe we provide this
+
|MSs  via pilots
*# Standards and Specifications
+
|-
*# Common code or Components
+
| '''3'''
*# Building Blocks
+
|DE4A Connector
*# Core Service Platforms
+
|2
*# Generic Services
+
|MSs  via pilots
* degree of meeting pilot's requirements? any gaps? Pilot leaders assess level of meeting requirements.
+
|-
* easy of implementation/configuration? separate section. Practical example of using BBs
+
| '''4'''
* performance of the BB? Fit for purpose?
+
|DE4A Playground
* any lessons learned?
+
|6
* enabler for something, e.g. Wallet or SEMPER
+
|DBA/SA/MA
* any recommendations?
+
|-
* barriers for implementation, what nature? technical?
+
|
* using the BBs, how much do they contribute/ degree of automation, e.g. USI pattern what types of patterns
+
|'''Semantic'''
* cyber security aspects?
+
|
* description of context BBs -> how to define sections -> DoA? general questions, specific process related questions, evaluated related questions
+
|
*
+
|-
*
+
| '''5'''
*
+
|Information Exchange Model
 
+
|7
==== questionnaire ====
+
|DBA/SA/MA/WP5 
For WP3,4 and 5
+
|-
 
+
| '''6'''
Which BB are used by which pilot, by which pattern, new BBs?
+
|Canonical Data Models
 
+
|6
Which SBB is implementing which ABB (from ref. arch.)? Harold
+
|DBA/SA/MA  DE and DO pilot partners
 
+
|-
Provide answers for the indicators above.
+
| '''7'''
 
+
|ESL (implemented as part of SMP/SML)
=== When ===
+
|1
TODO planning (April-May):
+
|WP5
 
+
|-
# draft questionnaire (first half of May)
+
| '''8'''
# KO and discuss with participants (second half of May)
+
|IAL
# finalize questionnaire and submit
+
|1
 
+
|WP5
M33 deadline of Wiki, preferably BB assessment takes place before Holidays
+
|-
 
+
| '''9'''
=== Envisaged output ===
+
|MOR
 
+
|1
=== recommendations/lessons learned ===
+
|MA  pilot partners
next steps:
+
|-
 
+
|
* plan KO/inputs
+
|'''eID/PoR'''
*
+
|
 
+
|
[[Category:wip]]
+
|-
 +
| '''10'''
 +
|SEMPER
 +
|1
 +
|DBA
 +
|-
 +
|
 +
|'''VC Pattern'''
 +
|
 +
|
 +
|-
 +
| '''11'''
 +
|SSI Authority agent
 +
|4
 +
|SA
 +
|-
 +
| '''12'''
 +
|SSI User agent (mobile)
 +
|4
 +
|SA
 +
|-
 +
| '''13'''
 +
|EBSI-ESSIF (CEF Blockchain)
 +
|1
 +
|WP5  (T5.4)
 +
|}

Revision as of 16:13, 27 January 2023

Building Block Assessment - 2nd Phase

The second phase of the assessment of the architecture building blocks (BBs) used in the DE4A project comes after the cataloging of an initial set of relevant BBs for the Project Start Architecture (PSA). While in the previous phase the BBs were assessed for their technical, administrative and operational maturity, in this phase a more constrained set of BBs actually implemented by the pilots was evaluated from a wider perspective.

Methodology

The methodology for evaluation was designed following general systemic principles, with a set of indicators including: usability, openness, maturity, interoperability, etc. The identification of the evaluation criteria and the analysis of the results have been approached from several perspectives: literature survey and thorough desktop research; revision and fine-tuning of the initial BB set and evaluation methodology, and an online questionnaire designed for gathering feedback by the relevant project partners:

-      Member States (MSs)

-      WP4 partners - Pilots (Doing Business Abroad - DBA, Moving Abroad - MA, and Studying Abroad - SA)

-      WP5 partners - for specific components


To revise and fine-tune the evaluation methodology developed in the first phase, as well as the set of BBs selected for assessment as a result, several meetings and consultations were held with the aforementioned project partners. This led to a narrower set of relevant BBs consisting of a subset of the ones assessed in the first phase, and news ones resulting from the piloting needs and implementation. To capture these specificities, a wide set of questions from the survey capture all aspects important for the decisions made and for future reuse. Several iterations over the initial set of questions were performed, determining the relevance according to the roles of the project partners that provided feedback. Finally, a process of feedback coordination was also determined for the pilot leaders, who gathered additional information by the pilot partners’ implementation of some of the BBs (or important aspects of them).

It is important to note that the division of partners according to their role in the project was done due to the difference in the set of BBs that they had experience with. This implies that not each partner evaluated the whole set of BBs, but only the BBs relevant for their practice and research in the DE4A project.

The final set of relevant BBs per partner type is given in Table 1, together with statistics on the number of assessments obtained for each BB.

Table 1 List of building blocks evaluated in the second phase, per relevant partner
# Building Block # of assessments on the BB Relevant partner(s)
Common Components
1 eDelivery (data exchange) 3 WP5/MSs
2 SMP/SML 2 MSs via pilots
3 DE4A Connector 2 MSs via pilots
4 DE4A Playground 6 DBA/SA/MA
Semantic
5 Information Exchange Model 7 DBA/SA/MA/WP5
6 Canonical Data Models 6 DBA/SA/MA DE and DO pilot partners
7 ESL (implemented as part of SMP/SML) 1 WP5
8 IAL 1 WP5
9 MOR 1 MA pilot partners
eID/PoR
10 SEMPER 1 DBA
VC Pattern
11 SSI Authority agent 4 SA
12 SSI User agent (mobile) 4 SA
13 EBSI-ESSIF (CEF Blockchain) 1 WP5 (T5.4)