PyCOMPSs Wordcount test, using files as task inputs, and dictionaries as task outputs (executed at Marenostrum IV supercomputer) Version 1
Download RO CrateName: Word Count
Contact Person: support-compss@bsc.es
Access Level: public
License Agreement: Apache2
Platform: COMPSs
Description
Wordcount is an application that counts the number of words for a given set of files.
To allow parallelism every file is treated separately and merged afterwards.
Execution instructions
Usage:
runcompss --lang=python src/wordcount.py datasetPath
where:
- datasetPath: Absolute path of the file to parse (e.g. /home/compss/tutorial_apps/python/wordcount/data/)
Execution Examples
runcompss --lang=python src/wordcount.py $(pwd)/data/
runcompss src/wordcount.py $(pwd)/data/
python -m pycompss src/wordcount.py $(pwd)/data/
Build
No build is required
Click and drag the diagram to pan, double click or use the controls to zoom.
Version History
COMPSs 3.3.pr (earliest) Created 2nd Nov 2023 at 11:09 by Raül Sirvent
COMPSs 3.3.pr version was used for the run
Frozen
COMPSs-3.3.pr6a7f564
Creators and SubmitterCreator
Additional credit
The Workflows and Distributed Computing Team (https://www.bsc.es/discover-bsc/organisation/scientific-structure/workflows-and-distributed-computing/)
Submitter
Views: 615
Created: 2nd Nov 2023 at 11:09
Last updated: 8th Nov 2023 at 15:46
AttributionsNone
Related items
Teams: Cluster Emergent del Cervell Humà, Workflows and Distributed Computing, WP6 - Tsunamis, WP7 - Earthquakes, WP8 - Anthropogenic geophysical extremes, WP5 - Volcanoes, Pillar I: Manufacturing, Pillar II: Climate, Pillar III: Urgent computing for natural hazards, eFlows4HPC general, COMPSs Tutorials
Organizations: Barcelona Supercomputing Center (BSC-CNS)
https://orcid.org/0000-0003-0606-2512
Established Researcher at Workflows and Distributed Computing Group, Computer Sciences department, Barcelona Supercomputing Center.
eFlows4HPC project aims at providing workflow software stack and an additional set of services to enable the integration of HPC simulations and modelling with big data analytics and machine learning in scientific and industrial applications. The project is also developing the HPC Workflows as a Service (HPCWaaS) methodology that aims at providing tools to simplify the development, deployment, execution and reuse of workflows. The project demonstrates its advances through three application Pillars ...
Teams: Cluster Emergent del Cervell Humà, Workflows and Distributed Computing, Pillar I: Manufacturing, Pillar II: Climate, Pillar III: Urgent computing for natural hazards, eFlows4HPC general, COMPSs Tutorials
Web page: https://eflows4hpc.eu
Distributed computing aims to offer tools and mechanisms that enable the sharing, selection, and aggregation of a wide variety of geographically distributed computational resources in a transparent way. The research done in this team is based on the past expertise of the group, and on extending it towards the aspects of distributed computing that can benefit from this expertise. The team at BSC has a strong focus on programming models and resource management and scheduling in distributed computing ...
