PyCOMPSs Wordcount test, using files as task inputs, and dictionaries as task outputs (executed at Marenostrum IV supercomputer)
Version 1

Workflow Type: COMPSs
Stable

Name: Word Count
Contact Person: support-compss@bsc.es
Access Level: public
License Agreement: Apache2
Platform: COMPSs

Description

Wordcount is an application that counts the number of words for a given set of files.

To allow parallelism every file is treated separately and merged afterwards.

Execution instructions

Usage:

runcompss --lang=python src/wordcount.py datasetPath

where:

  • datasetPath: Absolute path of the file to parse (e.g. /home/compss/tutorial_apps/python/wordcount/data/)

Execution Examples

runcompss --lang=python src/wordcount.py $(pwd)/data/
runcompss src/wordcount.py $(pwd)/data/
python -m pycompss src/wordcount.py $(pwd)/data/

Build

No build is required

Click and drag the diagram to pan, double click or use the controls to zoom.

Version History

COMPSs 3.3.pr (earliest) Created 2nd Nov 2023 at 11:09 by Raül Sirvent

COMPSs 3.3.pr version was used for the run


Frozen COMPSs-3.3.pr 6a7f564
help Creators and Submitter
Creator
Additional credit

The Workflows and Distributed Computing Team (https://www.bsc.es/discover-bsc/organisation/scientific-structure/workflows-and-distributed-computing/)

Submitter
Citation
Conejero, J. (2023). PyCOMPSs Wordcount test, using files (executed at Marenostrum IV supercomputer). WorkflowHub. https://doi.org/10.48546/WORKFLOWHUB.WORKFLOW.635.1
Activity

Views: 365

Created: 2nd Nov 2023 at 11:09

Last updated: 8th Nov 2023 at 15:46

help Attributions

None

Total size: 59.4 KB
Powered by
(v.1.14.1)
Copyright © 2008 - 2023 The University of Manchester and HITS gGmbH