No significant changes since 2.6.0; the only changes are to CI config, which should fix an error in building the Docker image.
As mentioned in the 2.6.0 release notes, Sydent will soon be forked by Element under an AGPLv3.0 licence (with CLA, for proprietary dual licensing). We expect this to be the last release of Sydent under the current Apache 2 licence.
You can read more about this here:
- https://matrix.org/blog/2023/11/06/future-of-synapse-dendrite/
- https://element.io/blog/element-to-adopt-agplv3/
The Matrix.org Foundation copy of the project will be archived. Any changes needed by server administrators will be communicated in Sydent's changelog, but we are striving to make this as seamless as possible.
- Pin CI to Python 3.11. (#583)
- Inline docker job definition in this repo, and update docker-related action versions. (#584)
Sydent will soon be forked by Element under an AGPLv3.0 licence (with CLA, for proprietary dual licensing). We expect this to be the last release of Sydent under the current Apache 2 licence.
You can read more about this here:
- https://matrix.org/blog/2023/11/06/future-of-synapse-dendrite/
- https://element.io/blog/element-to-adopt-agplv3/
The Matrix.org Foundation copy of the project will be archived. Any changes needed by server administrators will be communicated in Sydent's changelog, but we are striving to make this as seamless as possible.
- Fix installation documentation for Debian based systems. (#549)
- Fix a long-standing issue where Sydent would not verify the configured SMTP server's certificates. See GHSA-p6hw-wm59-3q5q and CVE-2023-38686. Reported by Martin Schobert, Pentagrid AG. (#574)
This version is fixing Docker builds.
- Add a config option
homeserver_allow_listto specify which homeservers can access Sydent. (#566)
- Warn would-be users that they probably don't want to use Sydent. (#557)
- Add ratelimiting to MSISDN request token endpoint. (#521, #522)
- Add
email.third_party_invite_homeserver_blocklistandemail.third_party_invite_room_blocklistconfig options to block invites from a list of homeservers or for a list of rooms. (#530) - Support Matrix v1.1. (#542)
- Respond with a 429 instead of 500 when exceeding invite rate limit. (#529)
- Fix a bug where Sydent would not retry attempts to inform homeservers of a successful bind after an initial failure. (#552)
- Add prometheus-client and sentry-sdk into the Docker image. (#519)
- Document a way to serve identity service APIs over HTTPS. (#518)
- Update README to describe how to install from source with poetry. (#505)
- Fix a typechecking error introduced in #501. (#506)
- Ensure CI runs tests on main branch. (#507)
- Bump twisted from 22.1.0 to 22.2.0. (#508)
- Add a 'tests-done' Github Actions job. (#509)
- Allow the newsfile job to be skipped. (#514)
- Remove support for the unstable identifier from MSC3288. (#515)
- Avoid spurious warnings in tests. (#516)
- (Dependabot) Bump Twisted to 22.4.0. (#517)
- Add ratelimiting to email sending. (#526)
- Add some prometheus metrics and make
prometheus_clientdependency mandatory. (#527) - Limit length of room names in third party invites. (#528)
- Limit length of sender display name in third party invites. (#531)
- Add a config option to drop emails if user-supplied content contains a given keyword. (#535, #536)
- (Dependabot) Bump certifi to 2022.12.7. (#537)
- Fix a typo to properly allow the newsfile job to be skipped. (#538)
- Refactor creation of servlets. (#541)
- Use ruff instead of flake8. (#543, #544)
- Don't block invites containing
web_client_locationwhen using "http" in the keyword block list. (#545) - Build using Poetry 1.2.2, for better dependabot compatability. (#548)
This release of Sydent is the first to use poetry to maintain a locked set of dependency versions. The use of poetry is optional: administrators can continue to install from a wheel or using their own virtualenv.
- Fix a bug where federation requests would fail early if a
.well-known/matrix/serverresponse contains an invalid type form.server. Instead, try finding an SRV record, as mandated by the spec. (#473) - Fix a bug in the casefolding script that would cause some deletions to be skipped if e-mail sending was enabled. (#489)
- Fix a bug introduced in Sydent 2.4.6 where errors communicating with OpenMarket's SMS API would be logged as successes, and all successes would be logged twice. (#490)
- Added a link to
#sydent:matrix.orgin the README so users know where to discuss sydent. Contributed by @clmnin. (#479)
- Add a test to ensure that a bad response from the OpenMarket SMS API raises an exception. (#471)
- Add missing dependencies to
setup.py. (#474) - Cache the lookup pepper in the
HashingMetadataStore. (#475, #477) - Update type annotations to ensure Sydent typechecks with recent mypy versions. (#481)
- Fix type errors caused by an update to PyNaCl. (#484)
- Add aggressive logging to
casefoldb.pyfor debugging purposes. (#486) - Use poetry to manage dependencies. (#488)
- Build and publish a docker image on the
mainbranch and tagged releases. (#492) - Update Dockerfile to use a fixed poetry environment, rather than
pip installing the latest dependencies. (#493) - Bump twisted from 21.7.0 to 22.1.0. (#495)
- Use matrix-common util to get a git-aware version number. (#497)
- Publish releases to PyPI using GitHub Actions. (#499)
- Mark
sentry-sdkandprometheus-clientas optional dependencies. (#501) - Add poetry entrypoint for running sydent. (#502)
This release fixes a bug in handling verification for third party IDs if requested via the deprecated /api/v1/ endpoint. The other changes are all designed to improve error handling, and make Sydent's logging have a higher signal-to-noise ratio.
- Return HTTP 400 Bad Request rather than HTTP 500 Internal Server Error if
/store-inviteis given an invalid email address. (#464)
- Fix a bug introduced in Sydent 2.5.0 where requests to validate an email or phone number would fail with an HTTP 500 Internal Server Error if arguments were given as a query string or as a www-form-urlencoded body. (#461, #462)
- Improve exception logging in
asyncjsonwrapfor better Sentry reports. (#455) - Handle federation request failures in
/requestexplicitly, to reduce Sentry noise. (#456) - Log a warning (not an error) when we refuse to send an SMS to an unsupported country. (#459)
- Demote a failure to parse JSON from homeservers in
/registerfrom an error to a warning. (#463) - Handle errors to contact homeservers in
/unbind. This returns a better error message and reduces Sentry spam. (#466) - Log failures to send SMS as exceptions, not errors (to better debug in Sentry). (#467)
This release deprecates .eml templates in favour of Jinja 2 .eml.j2 templates. See the documentation for more details.
- Fix a bug which could cause SMS sending to fail silently. (#412)
- Fix a bug introduced in v2.4.0 that caused association unbindings to fail with an internal server error. (#397)
- Fix an issue which could cause new local associations to be replicated multiple times to peers. (#400)
- Fix an issue where
obey_x_forwarded_forwas not being honoured. (#403) - Fix misleading logging and potential TypeErrors related to replication ports in Sydent's database. (#420)
- Fix a bug introduced in v2.0.0 where requesting
GETfrom/identity/api/v1/validate/msisdn/submitTokenor/identity/v2/validate/msisdn/submitTokenwould fail with an internal server error. (#445) - Fix
/v2/account/logoutto return HTTP 400 BAD REQUEST instead of 200 OK if a token was not provided. (#447) - Fix a long-standing spec compliance bug where the response to
POST /identity/{api/v1,v2}/3pid/unbindwasnull, not{}. (#449)
- Fix the documentation around the command line arguments for the email address migration script. (#392)
- Add documentation on writing templates. Deprecate .eml templates. (#395)
- Improve type annotations throughout Sydent. Sydent now passes
mypy --strict. (#414 and others). - Extend the changelog check so that it checks for the correct pull request number being used. (#382)
- Move the configuration file handling code into a separate module. (#385, #405)
- Add a primitive contributing guide and tweak the pull request template. (#393)
- Run mypy on the sydent package as part of CI. (#416)
- Configure @matrix-org/synapse-core to be the code owner for the repository. (#436)
- Run linters over stub files. (#441, #450)
- Include Sydent's version number (and git commit hash if available) when reporting to Sentry. (#453, #454)
- Fix a long-standing bug with error handling around missing headers when dealing with the OpenMarket API, which could cause the wrong assumption that sending a SMS failed when it didn't. (#415)
- Fix a long-standing bug in asynchronous code that could cause SMS messages not to be correctly sent. (#413)
- Fix a bug introduced in v2.4.0 which could cause SMS sending to fail silently. (#412)
- Fix a bug introduced in v2.4.0 that caused association unbindings to fail with an Internal Server Error. (#397)
- Fix a bug causing the email address migration script to take a lot of time to run due to inefficient database queries. (#396)
- Move dev tools from
install_requirestoextras_require. (#389) - Run background jobs in
runrather than in Sydent's constructor. (#394)
- Fix a bug preventing the email migration script from running while Sydent is already running with Prometheus metrics enabled. (#391)
This release drops compatibility with Python 3.5 and older. Python 3.6 and later is required to run Sydent from this version onwards.
Action required when upgrading: server administrators should run the e-mail address migration script.
- Experimental support for MSC3288, receiving
room_typefor 3pid invites over the/store-inviteAPI and using it in Jinja templates for Space invites. (#375) - Add support for using Jinja2 in e-mail templates. Contributed by @H-Shay. (#376)
- Case-fold email addresses when binding to MXIDs or performing look-ups. Contributed by @H-Shay. (#374, #378, #379, #386)
- Handle CORS for
GetValidated3pidServlet. Endpoint/3pid/getValidated3pidreturns valid CORS headers. (#342) - Use the
web_client_locationparameter in default templates for both text and HTML emails. (#380)
- Add
/_trial_temp.lockand/sydent.pidto .gitignore. (#384) - Reformat code using Black. Contributed by @H-Shay. (#344, #369)
- Configure Flake8 and resolve errors. (#345, #347)
- Add GitHub Actions for unit tests (Python 3.6 and 3.9), matrix_is_tester tests (Python 3.6 and 3.9), towncrier checks and black and flake8 codestyle checks. (#346, #348)
- Remove support for Python < 3.6. Contributed by @sunweaver. (#349, #356)
- Bump minimum supported version of Twisted to 18.4.0 and stop calling deprecated APIs. (#350)
- Replace deprecated
logging.warn()method withlogging.warning(). (#351) - Reformat imports using isort. (#352, #353)
- Update
.gitignoreto only ignoresydent.confandsydent.dbif they occur in the project's base folder. (#354) - Add type hints and validate with mypy. (#355, #357, #358, #360, #361, #367, #371)
- Convert
inlineCallbacksto async/await. (#364, #365, #368, #372, #373) - Use
mockmodule from the standard library. (#370) - Fix email templates to be valid python format strings. (#377)
Note: this will be the last release of Sydent to support Python 3.5 or earlier. Future releases will require at least Python 3.6.
This release contains fixes to the following security issues:
- Denial of service attack via disk space or memory exhaustion (CVE-2021-29430).
- SSRF due to missing validation of hostnames (CVE-2021-29431).
- Malicious users could control the content of invitation emails (CVE-2021-29432).
- Denial of service (via resource exhaustion) due to improper input validation (CVE-2021-29433).
Although we are not aware of these vulnerabilities being exploited in the wild, Sydent server administrators are advised to update as soon as possible. Note that as well as changes to the package, there are also changes to the default email templates. If any templates have been updated locally, they must also be updated in line with the changes to the defaults for full protection from CVE-2021-29432.
- Accept an optional
web_client_locationargument to the invite endpoint which allows customisation of the email template. (#326) - Move templates to a per-brand subdirectory of
/res. Addtemplates.pathandbrand.defaultconfig options. (#328)
- Fix a regression in v2.2.0 where the wrong characters would be obfuscated in a 3pid invite. (#317)
- Fix a long-standing bug where invalid JSON would be accepted over the HTTP interfaces. (#337)
- During user registration on the identity server, validate that the MXID returned by the contacted homeserver is valid for that homeserver. (cc97fff)
- Ensure that
/v2/endpoints are correctly authenticated. (ce04a68) - Perform additional validation on the response received when requesting server signing keys. (07e6da7)
- Validate the
matrix_server_nameparameter given during user registration. (9e57334, 8936925, 3d531ed, 0f00412) - Limit the size of requests received from HTTP clients. (89071a1, 0523511, f56eee3)
- Limit the size of responses received from HTTP servers. (89071a1, 0523511, f56eee3)
- In invite emails, randomise the multipart boundary, and include MXIDs where available. (4469d1d, 6b405a8, 65a6e91)
- Perform additional validation on the
client_secretandemailparameters to various APIs. (3175fd3)
- Base docker image on Debian rather than Alpine Linux. (#335)
- Fix test logging to allow braces in log output. (#318)
- Install prometheus_client in the Docker image. (#325)
- Bump the version of signedjson to 1.1.1. (#334)
- Fix intermittent deadlock in Sentry integration. (#312)
- Add a Dockerfile and allow environment variables
SYDENT_SERVER_NAME,SYDENT_PID_FILEandSYDENT_DB_PATHto modify default configuration values. (#290) - Add config options for controlling how email addresses are obfuscated in third party invites. (#311)
- Fix a bug in the error handling of 3PID session validation, if the token submitted is incorrect. (#296)
- Stop sending the unspecified
successparameter in responses to/requestTokenrequests. (#302) - Fix a bug causing Sydent to ignore
nextLinkparameters. (#303) - Fix the HTTP status code returned during some error responses. (#305)
- Sydent now correctly enforces the valid characters in the
client_secretparameter used in various endpoints. (#309)
- Replace instances of Riot with Element. (#308)
- Add a config option to disable deleting invite tokens on bind. (#293)
- Fix a bug that prevented Sydent from checking for access tokens in request parameters when running on Python3. (#294)
Changes in 2.0.0 (2020-02-25)
Note: Starting with this release, Sydent releases are available on
PyPI. This means that the
recommended method for stable installations is now by using the PyPI
project rather than a tarball of the master branch of this repository.
See the README
for more details.
Warning: This release deprecates v1 APIs for existing endpoints in favour of v2 APIs. Homeserver and client developers are encouraged to migrate their applications to the v2 APIs. See below for more information.
- Implement the items and MSCs from the privacy project targeting identity servers. This introduces v2 APIs for every existing endpoint. v1 APIs are now deprecated and homeserver and client developers are encouraged to migrate their applications to the v2 APIs.
- Add Python 3 compatibility to all of the codebase. Python 2 is still supported for now.
- Delete stored invites upon successful delivery to a homeserver
- Filter out delivered invites when delivering invites to a homeserver upon successful binding
- Implement support for authenticating unbind queries by providing a
sidand aclient_secret, as per MSC1915 - Add support for Prometheus and Sentry
- Handle
.well-knownfiles when talking to homeservers - Validate
client_secretparameters according to the Matrix specification - Return 400/404 on incorrect session validation
- Add a default 10,000 address limit on v2
/lookup(which supports multiple lookups at once)
- Rewrite part of the README to make it more user-friendly
- Fix a bug that would prevent requests to the
/store-inviteendpoint with JSON payloads from being correctly processed - Fix a bug where multiple cleanup tasks would be unnecessary spawned
- Fix logging so Sydent doesn't log 3PIDs when processing lookup requests
- Fix incorrect HTTP response from
/3pid/getValidated3pidendpoint on failure. - Prevent a single failure from aborting the federation loop
- Fix federation lookups in
/onBindcallbacks - Don't fail the unbind request if the binding doesn't exist
- Fix the signing servlet missing a reference to the Sydent object
- Fix content types & OPTIONS requests
- Add unit tests to test startup and replication
- Add support for testing with
matrix-is-tester - Remove instances of
setResponseCode(200)
Changes in 1.0.3 (2019-05-03)
- Use trustRoot instead of verify for request verification
- Ensures that authentication tokens are generated using a secure random number generator, ensuring they cannot be predicted by an attacker. Thanks to @opnsec for identifying and responsibly disclosing the issue!
- Mitigate an HTML injection bug where an invalid room_id could result in malicious HTML being injected into validation emails. Thanks to @opnsec for identifying and responsibly disclosing this issue too!
- Randomise session_ids to avoid leaking info about the total number of identity validations, and whether a given ID has been validated. Thanks to @fs0c131y for this one.
- Don't send tracebacks to the browser when errors occur.
Changes in 1.0.2 (2019-04-18)
- Fix for validating malformed email addresses: https://github.com/matrix-org/sydent/commit/3103b65dcfa37a9241dabedba560c4ded6c05ff6
Changes in 1.0.1 (2019-04-18)
Release pointed to wrong commit, fixed by 1.0.2