Matrix (An open network for secure, decentralized communication) server setup using Ansible and Docker
Go to file
Slavi Pantaleev 70fd20cef5 Add support for WeChat bridging
This is based on the PR (https://github.com/spantaleev/matrix-docker-ansible-deploy/pull/3241)
by Tobias Diez (https://github.com/tobiasdiez).

I've refactored some parts, made it more configurable, polished it up,
and it's integrated into the playbook now.

Both the WeChat bridge and WeChat agent appear to be working.
The WeChat bridge joins rooms and responds as expected.

That said, end-to-end testing (actually bridging to a WeChat account) has not been done yet.

Fixes https://github.com/spantaleev/matrix-docker-ansible-deploy/issues/701

Fixes https://github.com/spantaleev/matrix-docker-ansible-deploy/issues/3092

This is sponsored https://etke.cc/ work related to https://gitlab.com/etke.cc/ansible/-/issues/2

Squashed commit of the following:

commit fdd37f02472a0b83d61b4fac80650442f90e7629
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 21:05:53 2024 +0300

    Add documentation for WeChat bridge

commit 8426fc8b95bb160ea7f9659bd45bc59cf1326614
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 20:59:42 2024 +0300

    Rename directory for matrix_wechat_agent_container_src_files_path

commit da200df82bbc9153d307095dd90e4769c400ea1e
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 20:58:26 2024 +0300

    Make WeChat listen_secret configurable and auto-configured via matrix_homeserver_generic_secret_key

commit 4022cb1355828ac16af7d9228cb1066962bb35f5
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 20:54:56 2024 +0300

    Refactor install.yml for WeChat a bit (using blocks, etc.)

commit d07a39b4c4f6b93d04204e13e384086d5a242d52
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 20:52:35 2024 +0300

    Rename WeChat Agent configuration file

    This makes it more clear that it belongs to the agent.
    Otherwise, `config.yaml` and `configure.yaml` make you wonder.

commit ccca72f8d1e602f7c42f4bd552193afa153c9b9d
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 20:49:06 2024 +0300

    Move WeChat agent configuration to a template

commit a4047d94d8877b4095712dfc76ac3082a1edca28
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 20:47:17 2024 +0300

    Mount WeChat config as readonly and instruct bridge to not update it

commit bc0e89f345bf14bbdbfd574bb60d93918c2ac053
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 20:46:33 2024 +0300

    Sync WeChat config with upstream

    Brings up-to-date with:
    https://github.com/duo/matrix-wechat/commits/0.2.4/example-config.yaml

commit a46f5b9cbc8bf16042685a18c77d25a606bc8232
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 19:48:17 2024 +0300

    Rename some files

commit 3877679040cffc4ca6cccfa21a7335f8f796f06e
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 19:47:10 2024 +0300

    Update WeChat logging config

    This brings it up-to-date with what mautrix-go uses.
    Otherwise, on startup we see:

    > Migrating legacy log config

    .. and it gets migrated to what we've done here.

commit e3e95ab234651867c7a975a08455549b31db4172
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 19:43:37 2024 +0300

    Make sure matrix-wechat-agent runs as 1000:1000

    It needs to write stuff to `/home/user/.vnc`.

    `/home/user` is owned by `user:group` (`1000:1000`), so it cannot run
    any other way.

    Previously, if the `matrix` user was uid=1000 by chance, it would work,
    but that's pure luck.

commit 4d5748ae9b84c81d6b48b0a41b790339d9ac4724
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 18:57:09 2024 +0300

    Pin wechat and wechat-agent versions

commit 40d40009f19ebceed4126146cbb510a2c95af671
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 18:53:58 2024 +0300

    docker_image -> container_image for WeChat bridge

commit cc33aff592541913070d13288d17b04ed6243176
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 18:00:25 2024 +0300

    docker_src -> container_src in WeChat bridge

commit 42e6ae9a6483c8ca6d53b8052058d41d90d93797
Author: Slavi Pantaleev <slavi@devture.com>
Date:   Mon Jun 3 17:54:24 2024 +0300

    matrix_go_wechat_ -> matrix_wechat_

    The bridge is written in Go, but does not include Go anywhere in its
    name. As such, it's mostly useless to use `matrix_go_wechat` as the
    prefix.

commit d6662a69d1916d215d5184320c36d2ef73afd3e9
Author: Tobias Diez <code@tobiasdiez.de>
Date:   Mon Mar 25 10:55:16 2024 +0800

    Add wechat bridge
2024-06-03 21:28:50 +03:00
.config Disable var-naming[no-role-prefix] ansible-lint rule 2023-07-12 08:18:50 +03:00
.github Update frenck/action-yamllint action to v1.5.0 2024-02-16 15:28:04 +00:00
bin Add support for bridging to Facebook Messenger and Instagram via mautrix-meta 2024-02-19 10:25:00 +02:00
collections fix: all praise the allmighty yamllinter 2022-02-05 21:32:54 +01:00
docs Add support for WeChat bridging 2024-06-03 21:28:50 +03:00
examples Revert "become -> ansible_become" 2024-03-26 11:59:13 +02:00
group_vars Add support for WeChat bridging 2024-06-03 21:28:50 +03:00
roles/custom Add support for WeChat bridging 2024-06-03 21:28:50 +03:00
.editorconfig Add justfile to .editorconfig 2023-03-28 10:55:43 +03:00
.envrc Added a nix flake 2023-04-16 19:04:35 +00:00
.gitattributes add .gitattributes with checking out with lf line endings 2023-10-23 19:09:30 +03:00
.gitignore chore: fix nix flake (#3259) 2024-04-09 10:22:45 +03:00
.yamllint remove old workers.yml (already saved into main.yml) 2022-11-04 19:02:24 +02:00
ansible.cfg Use the yaml callback plugin when running ansible-playbook 2021-02-18 15:57:05 +01:00
CHANGELOG.md Fix year number in CHANGELOG section 2024-03-26 13:26:50 +02:00
flake.lock chore: fix nix flake (#3259) 2024-04-09 10:22:45 +03:00
flake.nix chore: fix nix flake (#3259) 2024-04-09 10:22:45 +03:00
jitsi_jvb.yml Ensure docker is installed on additional JVBs (fixes #2706) 2023-06-17 15:04:35 +03:00
justfile Add support for bridging to Facebook Messenger and Instagram via mautrix-meta 2024-02-19 10:25:00 +02:00
LICENSE Add LICENSE file 2018-08-17 09:01:06 +03:00
Makefile Try to fix ansible-lint Github action 2022-11-20 19:13:00 +02:00
README.md Add Pantalaimon support 2024-03-24 18:35:34 +02:00
requirements.yml chore(deps): update dependency etherpad to v2.1.0-0 2024-06-03 12:22:37 +00:00
setup.yml Add support for WeChat bridging 2024-06-03 21:28:50 +03:00
YEAR-IN-REVIEW.md Replace (almost) all matrix-org/synapse references with element-hq/synapse 2024-01-17 08:02:47 +02:00

Support room on Matrix donate

Matrix (An open network for secure, decentralized communication) server setup using Ansible and Docker

Purpose

This Ansible playbook is meant to help you run your own Matrix homeserver, along with the various services related to that.

That is, it lets you join the Matrix network using your own @<username>:<your-domain> identifier, all hosted on your own server (see prerequisites).

We run all services in Docker containers (see the container images we use), which lets us have a predictable and up-to-date setup, across multiple supported distros (see prerequisites) and architectures (x86/amd64 being recommended).

Installation (upgrades) and some maintenance tasks are automated using Ansible (see our Ansible guide).

Self-hosting or SaaS

This Ansible playbook tries to make self-hosting and maintaining a Matrix server fairly easy. Still, running any service smoothly requires knowledge, time and effort.

If you like the FOSS spirit of this Ansible playbook, but prefer to put the responsibility on someone else, you can also get a managed Matrix server from etke.cc - a service built on top of this Ansible playbook, which can help you run a Matrix server with ease.

If you like learning and experimentation, but would rather reduce future maintenance effort, you can even go for a hybrid approach - self-hosting manually using this Ansible playbook at first and then transferring server maintenance to etke.cc at a later time.

Supported services

Using this playbook, you can get the following list of services configured on your server. Basically, this playbook aims to get you up-and-running with all the necessities around Matrix, without you having to do anything else.

Note: the list below is exhaustive. It includes optional or even some advanced components that you will most likely not need. Sticking with the defaults (which install a subset of the above components) is the best choice, especially for a new installation. You can always re-run the playbook later to add or remove components.

Homeserver

The homeserver is the backbone of your matrix system. Choose one from the following list.

Name Default? Description Documentation
Synapse Storing your data and managing your presence in the Matrix network Link
Conduit x Storing your data and managing your presence in the Matrix network. Conduit is a lightweight open-source server implementation of the Matrix Specification with a focus on easy setup and low system requirements Link
Dendrite x Storing your data and managing your presence in the Matrix network. Dendrite is a second-generation Matrix homeserver written in Go, an alternative to Synapse. Link

Clients

Web clients for matrix that you can host on your own domains.

Name Default? Description Documentation
Element Web UI, which is configured to connect to your own Synapse server by default Link
Hydrogen x Lightweight matrix client with legacy and mobile browser support Link
Cinny x Simple, elegant and secure web client Link
SchildiChat x Based on Element, with a more traditional instant messaging experience Link

Server Components

Services that run on the server to make the various parts of your installation work.

Name Default? Description Documentation
PostgreSQL Database for Synapse. Using an external PostgreSQL server is also possible. Link
Coturn STUN/TURN server for WebRTC audio/video calls Link
Traefik Web server, listening on ports 80, 443 and 8448 - standing in front of all the other services. Using your own webserver is possible Link
Let's Encrypt Free SSL certificate, which secures the connection to all components Link
ma1sd x Matrix Identity Server Link
Exim Mail server, through which all Matrix services send outgoing email (can be configured to relay through another SMTP server) Link
Dimension x An open source integrations manager for matrix clients Link
Sygnal x Push gateway Link
ntfy x Push notifications server Link

Authentication

Extend and modify how users are authenticated on your homeserver.

Name Default? Description Documentation
matrix-synapse-rest-auth (advanced) x REST authentication password provider module Link
matrix-synapse-shared-secret-auth (advanced) x Password provider module Link
matrix-synapse-ldap3 (advanced) x LDAP Auth password provider module Link
matrix-ldap-registration-proxy (advanced) x A proxy that handles Matrix registration requests and forwards them to LDAP. Link
matrix-registration x A simple python application to have a token based matrix registration Link

File Storage

Use alternative file storage to the default media_store folder.

Name Default? Description Documentation
Goofys x Amazon S3 (or other S3-compatible object store) storage for Synapse's content repository (media_store) files Link
synapse-s3-storage-provider x Amazon S3 (or other S3-compatible object store) storage for Synapse's content repository (media_store) files Link
matrix-media-repo x matrix-media-repo is a highly customizable multi-domain media repository for Matrix. Intended for medium to large deployments, this media repo de-duplicates media while being fully compliant with the specification. Link

Bridges

Bridges can be used to connect your matrix installation with third-party communication networks.

Name Default? Description Documentation
mautrix-discord x Bridge to Discord Link
mautrix-slack x Bridge to Slack Link
mautrix-telegram x Bridge to Telegram Link
mautrix-gmessages x Bridge to Google Messages Link
mautrix-whatsapp x Bridge to WhatsApp Link
mautrix-facebook x Bridge to Facebook Link
mautrix-twitter x Bridge to Twitter Link
mautrix-hangouts x Bridge to Google Hangouts Link
mautrix-googlechat x Bridge to Google Chat Link
mautrix-instagram x Bridge to Instagram Link
mautrix-signal x Bridge to Signal Link
beeper-linkedin x Bridge to LinkedIn Link
matrix-appservice-irc x Bridge to IRC Link
matrix-appservice-discord x Bridge to Discord Link
matrix-appservice-slack x Bridge to Slack Link
matrix-appservice-webhooks x Bridge for slack compatible webhooks (ConcourseCI, Slack etc. pp.) Link
matrix-hookshot x Bridge for generic webhooks and multiple project management services, such as GitHub, GitLab, Figma, and Jira in particular Link
matrix-sms-bridge x Bridge to SMS Link
Heisenbridge x Bouncer-style bridge to IRC Link
go-skype-bridge x Bridge to Skype Link
mx-puppet-slack x Bridge to Slack Link
mx-puppet-instagram x Bridge for Instagram-DMs (Instagram) Link
mx-puppet-twitter x Bridge for Twitter-DMs (Twitter) Link
mx-puppet-discord x Bridge to Discord Link
mx-puppet-groupme x Bridge to GroupMe Link
mx-puppet-steam x Bridge to Steam Link
Email2Matrix x Bridge for relaying emails to Matrix rooms Link

Bots

Bots provide various additional functionality to your installation.

Name Default? Description Documentation
matrix-reminder-bot x Bot for scheduling one-off & recurring reminders and alarms Link
matrix-registration-bot x Bot for invitations by creating and managing registration tokens Link
maubot x A plugin-based Matrix bot system Link
honoroit x A helpdesk bot Link
Postmoogle x Email to matrix bot Link
Go-NEB x A multi functional bot written in Go Link
Mjolnir x A moderation tool for Matrix Link
Draupnir x A moderation tool for Matrix (Fork of Mjolnir) Link
Buscarron x Web forms (HTTP POST) to matrix Link
matrix-chatgpt-bot x ChatGPT from matrix Link

Administration

Services that help you in administrating and monitoring your matrix installation.

Name Default? Description Documentation
synapse-admin x A web UI tool for administrating users and rooms on your Matrix server Link
Metrics and Graphs x Consists of the Prometheus time-series database server, the Prometheus node-exporter host metrics exporter, and the Grafana web UI Link
Borg x Backups Link
Rageshake x Bug report server Link

Misc

Various services that don't fit any other category.

Name Default? Description Documentation
sliding-sync x Sliding Sync support for clients which require it (e.g. Element X) Link
synapse_auto_accept_invite x A Synapse module to automatically accept invites. Link
synapse_auto_compressor x A cli tool that automatically compresses state_groups database table in background. Link
synapse-simple-antispam (advanced) x A spam checker module Link
Matrix Corporal (advanced) x Reconciliator and gateway for a managed Matrix server Link
Etherpad x An open source collaborative text editor Link
Jitsi x An open source video-conferencing platform Link
Cactus Comments x A federated comment system built on matrix Link
Pantalaimon x An E2EE aware proxy daemon Link

Installation

To configure and install Matrix on your own server, follow the README in the docs/ directory.

Changes

This playbook evolves over time, sometimes with backward-incompatible changes.

When updating the playbook, refer to the changelog to catch up with what's new.

Support

You may also be interested in mash-playbook - another Ansible playbook for self-hosting non-Matrix services (see its List of supported services).

mash-playbook also makes use of Traefik as its reverse-proxy, so with minor interoperability adjustments, you can make matrix-docker-ansible-deploy and mash-playbook co-exist and host Matrix and non-Matrix services on the same server.