Changelog

All notable changes to this project will be documented in this file. The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[0.8.1] 2023 / 01 / 30

Added

[-]

Changed

  • More Log information

  • can take into account full name workflow.py instead of “workflow”

Fixed

  • lemmings Kill issues

Deprecated

  • avoid custom pathTools bizarre initialization at startup.

[0.8.0] 2022 / 6 / 23

Added

  • Sandbox mock job scheduler

  • test suite, including recursive and farming cases

  • tutorials sandcastle and sandcastle-farming

  • accurate Logging files

Changed

  • [MAJOR CHANGE] package is now lemmingsnot lemmings-hpc

  • progress variable set with LemmingJob.set_progress_var() now (simpler than with a database)

  • check_on_start() is now void, as expected.

  • database use an official and efficient lock mechanism.

Fixed

  • Testing is back in CI

  • add dependency to nob and lock

Deprecated

  • CLI lemmings_hpc deprecated

  • restart option replaced by disc based workflows

[0.7.0] 2022 / 5 / 13

Added

[ - ]

Changed

  • plenty of cleaning

  • move to setup.cfg

Fixed

  • corrections on avbp_recursive

Deprecated

[ - ]

[0.6.0] 2021 / 10 / 4

Added

  • lemmings-farming with custom machine by user in workflow.yml

  • setup.cfg

  • versioning

Changed

  • change –user-machine to –machine-file

  • change –custom-machine in farming to –enable-queues-from-yaml or -eqfy

  • use job_prefix and add_farming_suffix to control workflow and chain names in farming mode

  • setup.py, cli

Fixed

[ - ]

Deprecated

[ - ]

[0.5.0] 2021 / 09 / 3

Added

  • Option to override job prefix in the farming mode through keyword “_override_job_prefix” in the parameter_array

  • Option to specify –job-prefix for lemmings run which will override the existing one (required for above feature)

  • Option to specify machine path in CLI and act accordingly in lemmings batch_pjob creation

  • Add entry points lemmings and lemmings-farming

  • Add cli status, clean, run and kill for lemmings and lemmings-farming

  • Add Depreciation Warnings to lemmings-hpc status, clean, run and kill

Changed

  • Update REAMDE with Depreciation Warning and new entry points

Fixed

[ - ]

Deprecated

  • lemmings-hpc run – redirect to new cli calls

[0.4.4] 2021 / 08 / 27

Added

  • First docs version for ReadTheDocs

  • Link to gitlab and docs in setup.py

  • lemmings-hpc info to get queue info from machine file

  • lemmings-hpc kill for parallel mode

Changed

  • Update barbatruc example

  • Update barbatruc tutorial in docs

Fixed

[ - ]

Deprecated

[ - ]

[0.4.3] 2021 / 08 / 24

Added

  • Remove WF folders from latest parallel chain in lemmings-hpc clean

  • Tests for get current status including parallel version

  • PrettyTable version requirement

  • Extra tests get current status for 1st loop cases in database

Changed

  • Deactivate write_log_file at end as too AVBP related for now

Fixed

  • Reactivate TypeError in cli when database is busy

  • Bugfix identification of progress quantity in lemmings status with progress

  • Update analyse_cuts.py script to latest pyavbp functionalities

  • Correct rendering for first loop if running

Deprecated

[ - ]

[0.4.2] 2021 / 08 / 20

Added

  • possibility for lemmings status with a directory path where default name database.yml will be sought for

  • possibility to output progress for parallel mode in lemmings status

Changed

  • Parallel workflow names set to WF instead of Workflow

Fixed

  • Correct representation of first loop if its the only loop and condition reached

Deprecated

[ - ]

[0.4.1] 2021 / 08 / 20

Added

[ - ]

Changed

[ - ]

Fixed

  • Bugfix add empty end message to newly initialised loop after check on end

Deprecated

[ - ]

[0.4.0] 2021 / 08 / 19

Added

  • lemmings_hpc –restart option to append to latest existing chain

Changed

  • refactor create_replicate_workflows() splitting in smaller function calls

  • change call to database.initialise_new_loop() and refactor lemmings accordingly

Fixed

  • tests lemmings farming updated, pyavbp v2 not working due to pyavbp related import

  • Updated different tests to accommodate changes related to –restart option

Deprecated

[ - ]

[0.3.0] 2021 / 07 / 9

Added

  • function create_replicates() in chain.py to generate multiple workflows and run lemmings in parallel

  • call to create_replicates() from CLI

  • activation parallel mode in workflow.yml file

  • add example/test_workflow to check the implementations

  • add yaml path in batch_pjob which allows relative paths

  • nested object functionalities in database

  • max_parallel_workflows optional from workflow.yml for limiting the number of lemming chains submitted

  • add monitor_replicates() function which launches new workflows

  • function to handle exceptions in workflow

  • function to deal with parallel mode in chain

  • option to specify database path in lemmings status

  • separate function call to customise end message in lemmings status

  • function to set the progress quantity for lemmings status

Changed

  • lemmings status format update

  • get_current_status returns a list of strings that can be accessed by user

Fixed

  • Lemmings output status adapted in case solut path does not change

  • run check_on_end() even after cpu condition reached to update database

  • update previous existing tests to current version

  • Update avbp_trappedvtx example

  • README.md lemmings to lemmings_hpc

Deprecated

[ - ]

[0.2.3] 2021 / 05 / 7

Added

  • Prep for first PyPI release

  • lemmings status TypeError handling when database.yml file being edited by other program

Changed

  • change of lemmings to lemmings-hpc with src/lemmings_hpc due to PyPi

  • update README

Fixed

[ - ]

Deprecated

[ - ]

[0.2.2] 2021 / 04 / 27

Added

  • lemmings clean CLI command

Changed

[ - ]

Fixed

[ - ]

Deprecated

[ - ]

[0.2.1] 2021 / 04 / 14

Added

[ - ]

Changed

[ - ]

Fixed

  • Handle CPU condition reached scenario with ending message and after end job method

Deprecated

[ - ]

[0.2.0] 2021 / 04 / 13

Added

  • update CLI for user defined .yml path

  • raise ValueError if file is empty

  • handle AttributeError is cpu_limit not defined in .yml file

  • example avbp trappedvtx

  • example avbp trappedvtx with postproc coupled and decoupled

  • create batch files as part of lemmings with option to be user defined

  • LemmingsStop class to safely exit lemmings on exceptions

  • Default methods as part of lemmingjob_base which can be overwritten by user defined once

  • Add lemmings status for during job run

  • check in Machine class that core_nb specified by the user

  • end messages in database across chain that can be output by lemmings status

Changed

  • Update README.md

  • move example folder to main directory

  • update docs barbatruc tutorial

  • updated exception handling for .yml and .py workflow files

  • handling crash and database upon check_on_end()

  • remove tekigo workflows

  • remove lemmings info CLI option for now

  • remove workflows directory with default workflows

  • moved current lemmings status to lemmings endlog

  • Update get_cpu_cost in machine.py allowing to handle different return formats

  • remove ‘lemmings init’ command

Fixed

[ - ]

Deprecated

[ - ]

[0.1.0] 2020 / 07 / 01

Added

  • New folder created with the chain name as name:

    • .log file with some parameters of each loop

    • avbp log files

    • run.params when user launch lemmings

  • New documentation in the README file

  • New argument in the wf configuration file : solution_writing_time

  • New argument in the wf configuration file : job_prefix (put a prefix before the auto generate chain name)

Changed

  • Lemmings run command raise an error if the workflow contains an extension (avbp_recusrif{.yml})

Fixed

[ - ]

Deprecated

[ - ]

[0.0.1] 2020 / 06 / 20

First version of Lemmings, a job schedulers wrapper

  • workflow: avbp_recursif, avbp_p40, avbp_outilbest

  • lemmings CLI