- Sequence has a new home: https://gitlab.com/sequence
- The namespace has been updated from
Reductech.SequencetoSequence
Significant performance improvements in Core.
Please see the Core Changelog for more details on all the new and exciting Sequence Configuration Language and Step changes.
- Create a benchmark project #206
- Update benchmarks #210
- Update namespace and paths after move to Sequence group #216
- Added new Microsoft365 connector for the Microsoft 365 Graph API.
- SQL connector now has additional options for connecting to MS SQL databases.
Please see the Core Changelog for more details on all the new and exciting Sequence Configuration Language and Step changes.
Bug fix release.
- Incorrect connector versions in release #179
- Add job to CI to check connector versions when preparing for release #180
- Automatically upload releases to get.sequence.sh #181
Maintenance release - dependency updates only.
Please see the Core Changelog for more details on all the new and exciting Sequence Configuration Language and Step changes.
Maintenance release - dependency updates only.
Please see the Core Changelog for more details on all the new and exciting Sequence Configuration Language and Step changes.
It's now possible to inject variables into SCL from the command line:
PS > ./sequence run scl "log <a> + <b>" -v "<a> = 1" -v "<b> = 2"Please see the Core Changelog for more details on all the new and exciting Sequence Configuration Language and Step changes.
- Users should be able to inject SCL variables using the CLI #130
- Could not start performance monitoring: Access to the registry key 'Global' is denied error #123
- Failed to load connector configuration error when updating connectors #136
- Check if possible to remove the custom test dev job #107
EDR is now Sequence. The following has changed:
- The
edrconsole application is nowsequence. - This project has been renamed to
console. - The GitLab group has moved to https://gitlab.com/reductech/sequence
- The root namespace is now
Reductech.Sequence - The documentation site has moved to https://sequence.sh
Everything else is still the same - automation, simplified.
The project has now been updated to use .NET 6.
- Added Performance monitoring to
sequence.exe. This can be configured in appsettings.json and is currently only compatible with Windows. sequence connector add/updatenow take a search string as input instead of the full connector name. e.g.sequence connector add restwill add theReductech.Sequence.Connectors.Restconnector to the configuration.
- Add memory use to analytics output #100
- Filter out EDR connectors #105
- Allow partial configuration names in connector update command #106
- Using the Connector Add command should work even with the short name of the connector #102
- sign stage needs powershell to run #114
- Rename EDR to Sequence #104
- Upgrade to use .net 6 #96
This release updates Core to v0.12.0 which includes many changes to the Sequence Configuration Language, including new step and parameter aliases, and support for JSON schemas to convert and validate entities between various data sources. For more information please see the release notes for Core:
https://gitlab.com/reductech/edr/core/-/tags/v0.12.0
- EDR now logs analytics after each run. This can be controlled by the
LogAnalyticssetting.
- EDR should print analytics after every run #88
- Add smoke test for core only #87
-
Added new lambda syntax for steps which take a function as a parameter.
Instead of writing
Foreach [1,2,3] (Log <x>) <x>you now writeForeach [1,2,3] (<x> => Log <x>)orForeach [1,2,3] (Log <>) -
Allowed Step Parameters to be Discriminated Unions. This allows a parameter to be e.g. either a name or an Id.
-
When accessing entity properties you can now use a dot to indicate a nested property
Instead of
(a:(b: 1))['a']['b']you can now write(a:(b: 1))['a.b']
- The EDR Connector for Relativity® has now been release and can be downloaded from the Connector Registry
- EDR Smoke Tests are failing with Core 0.11 #85
- Added
ArrayGroupBystep
- Added the automatic variable
<>which can be used instead ofEntity
- Added
edr connector updatecommand
- Add update subcommand to connector command #79
- Add environment-specific settings and connector configuration support #73
- Update the documentation generation SCL #77
- Automatically update connectors in test package jobs #80
- Update Stryker version to allow mutation testing #29
- Update the version of Core to support CallerMetadata #76
Bug fixes and dependency updates:
- Fixed missing core docs when building in CI
- Connector Manager updated to v0.2.1
- Add package tests for tesseract connector #72
- Add EDR package tests for SQL connector #61
- The command line options have been reworked. There are now four commands:
| Command | Description |
|---|---|
connector |
Add/update/remove/find Connectors |
run |
Run SCL from path or from string |
steps |
List all available steps |
validate |
Check that SCL file or string works |
For more information on how to use EDR, see the readme.
- Connectors are now packaged as plugins
- Add doc generation to example tests #67
- Add a way of managing connector packages #66
- Add command to list steps and descriptions #68
- Use plugins instead of packages for connectors #65
- Added
AssertEqualGetSettingsNuixGetVersionPwshRunScriptAsync
- Updated
NuixAddConcordance- added parameters to customise processing optionsPwshRunScriptnow runs without having to read its output
- Stop using single file publish #63
- Revert back to using --no-build for package jobs #34
- EDR.exe now returns a non-zero exit code in case of failure.
- Make EDR return a non-zero exit code on error #59
- Add tests for the EDR.exe package #43
- SCL now supports string interpolation
- EntityGetValue now supports nested entities
- Additional Steps and Parameters for the Nuix Connector
For all changes in this release, please see the Core and Connector changelogs.
Bug fix release.
- Documentation step should generate summaries for steps #53
- Set default log level to debug for file and info for console #52
- Version 0.5.0 has incorrect powershell connector version #54
- Added
BuildFlag (-b) to validate SCL without running
- Logging is now structured
- Added elastic target
For all changes in this release, please see the Core and Connector changelogs.
- Update Version of Core to support Structed Logging #50
- Add Pwsh connector to EDR #42
- Add elastic target for nlog #47
- Add a Build Command line parameter to support IDE plugins #45
- Add CI job to publish documentation as gitlab pages #36
- package pwsh jobs fail when using prerelease version #49
- Bug: Unhandled exception after using Nuix #48
Major rework of the configuration language and data streaming features so lots of breaking changes:
- Moved from YAML-based configuration to a custom configuration
language called SCL (Sequence Configuration Language)
- Using a custom ANTLR grammar to parse the configuration language
- The new language is similar to YAML
- Consolidated entity streams, lists and array into a single datatype -
Array<T>- There are no longer separate Steps for arrays and entity streams (e.g.
ForEach,IsEmpty,Length)
- There are no longer separate Steps for arrays and entity streams (e.g.
- Consolidated strings and data streams into a single datatype -
StringStream - Reworked logging and exceptions
- More frequent and more consistent logging
- Added step scopes
- Added localization features
- Added support for appending custom metadata
Also:
- Added Step to execute inline Ruby scripts when running the Nuix Connector
- Added steps for working with JSON and IDX
- Documentation has now been moved to https://docs.reductech.io
- Update to .NET 5.0
For more details see the release notes for core and connectors:
- Change settings to use Dynamic Settings #38
- Print results of steps that do not return type Unit, to make the config more concise #27
- Use dependency injection for connector and logging configuration #22
- Update to latest version of Core and Connectors, to include new language features #32
- Upgrade to dot net 5 #28
- Package stage no longer works after .net 5 update #33
- App and nlog config files do not work with PublishSingleFile #21
- Add nuixconnectorscript to the package artifacts #39
- Set default log level to Info #37
- Add .editorconfig file and standardize formatting #35
- Temporarily disable dotnet-stryker CI job #31
- Embed debug symbols in the single file application #30
- Added Entities and EntityStreams along with LINQ-style methods to manipulate them.
- Added Entity Schemas to allow conversion between different formats/types
- Added Steps to convert
EntityStreamto/from concordance and CSV
The way the Nuix connector interacts with Nuix has been rewritten - functions and data are now streamed to Nuix so there is no longer a requirement for script composition and there is a performance increase when dealing with conditional/flow operators.
- This version only supports Nuix 8 (to be resolved in
0.4.0) - Step and argument names have changed to make them more
consistent. Step names now follow the convention of NamespaceAction, e.g.
ArrayLength,ArraySort,EntityMap,EntityStreamSort
- Add Examples to make it easier to demo #25
- Add Release issue template #19
- Use template ci config, so that it's easier to maintain #20
- Add ci stage to sign binaries #24
- Create Unit Tests so we can be confident the Console app is working #13
- Make error messages more verbose, so technicians can debug their yaml more easily #14
- Move in ConsoleMethods from Core #12
- Use NLog for logging, so that technicians can customise log output #11
- Output to console does not work #6
- Add issue templates #8
- Update to the latest version of Core #10
- 'Execute' should be the default method to save technicians from extra typing #7
- The paradigm by which Processes are defined has changed from functional to procedural
- A 'Process' is now a 'Step'
- Many new General Steps have been added to support the new paradigm (e.g. SetVariable, GetVariable, MathOperator)
- The yaml specification has changed entirely so yaml from the previous versions will not work with this version (please see readme)
- Idol processes have been removed. They will return again in a later version.
For further details, please see the following epics:
- Update to version 0.2.0 of Core and Nuix #4
- Adjust namespaces to match new hierarchy #2
Initial release. Console application to integrate EDR connectors.