페이지 이력

The processing of data can be tightly integrated into data handling systems, or can be delegated to a separate set of services invoked on demand. In general, the more complicated processing tasks will require the use of separated services. The provision of dedicated processing services becomes significantly more important when large quantities of data are being curated within a research infrastructure. Scientific data is an example which is often subject to extensive post-processing and analysis in order to extract new results. The data processing objects of an infrastructure encapsulate the dedicated processing services made available to that infrastructure, either within the infrastructure itself or delegated to a client infrastructure.

CV data processing objects are described as a set of CV Component Objects#process_process controller (representing the computational functionality of registered execution resources) monitored and managed by a CV Service Objects#coordination_coordination service. The coordination service delegates all processing tasks sent to particular execution resources, coordinates multi-stage workflows and initiates execution. Data may need to be data _ staging onto individual execution resources and results data _ persistence for future use; data channels can be established with resources via their process controllers. The following diagrams shows the staging and persistence of data.

...