ace3 server102

OS

• (Ubuntu 24.04 LTS code-name Noble Numbat)
• Ubuntu 22.04 LTS code-name Jammy Jellyfish

main packages

• web server: Apache 2.4
• application server: WildFly 27.0.1.Final (voor ace3, niet geïnstalleerd via de package manager)
• db server: MySQL 8.0.42 (voor ace3)
• programmeertaal perl 5.34 (voor de wiki)

lamp values

• release: 21 April 2022
• EOL April 2027 (5 years standard support), April 2032 (Extended Security Maintenance)

• release: 20 December 2021

• release: 15/04/2025
• EOL: April 2026

PuTTY configuration

• Session
  Host Name (or IP address): 52.208.41.170 (server102.explio.com)
  Port: 22
  • Login
• Connection
  • Data
    Login details
    Auto-login username: admin
  • SSH
    • Auth
      Authentication parameters
      Private key file for authentication:
      C:\UserKeys\explio-aws102.ppk
      
      • GSSAPI
    • Tunnels
      Source port: 23306 - Destination: localhost:3306 (database)
      Source port: 28888 - Destination: localhost:80 (server-info, server-status, jk-status, jk-manager)
      Source port: 8084 - Destination: localhost:8084 (ace3dev)
      Source port: 8088 - Destination: localhost:8088 (digwb)
      Source port: 8092 - Destination: localhost:8092 (demo)
      Source port: 8096 - Destination: localhost:8096 (---reserve---)
      Source port: 8100 - Destination: localhost:8100 (elan)
      Source port: 8104 - Destination: localhost:8104 (hu)
      Source port: 8108 - Destination: localhost:8108 (ste)
      Source port: 8112 - Destination: localhost:8112 (ilearn)
      Source port: 8116 - Destination: localhost:8116 (hybrid)
      Het prefix '2' voor 3306 en 8888 wordt gebruikt om geen overlap te hebben met server101.

WinSCP configuration

• Host name: ec2-52-208-41-170.eu-west-1.compute.amazonaws.com
• Port number: 22
• User name: admin
  • Advanced... button: Advanced Site Settings
    SSH > Authentication:
    Authentication parameters
    Private key file: C:\UserKeys\explio-aws102.ppk
• sudo su settings:
  • Advanced... button: Advanced Site Settings
    Environment > SFTP:
    SFTP server: sudo su -c /usr/lib/sftp-server

Connectivity test, with active PuTTY connection

port/ip	type	127.0.0.1	52.208.41.170
22	ssh
tunnel destination: 80 tunnelsource: 8888	server-info, server-status, jk-status, jk-manager
tunnel destination: 3306 tunnel source: 23306	MySQL
tunnel dest & src: 8088	digwb
tunnel dest & src: 8084	dev
tunnel dest & src: 8092	demo
tunnel dest & src: 8100	elan
tunnel dest & src: 8104	hu
tunnel dest & src: 8108	ste
tunnel dest & src: 8112	ilearn
tunnel dest & src: 8116	hybrid

Upgrade 22.04.5 LTS ► 24.04

Upgrade packages 22.04.2 LTS ► 22.04.5 LTS

Down op 11/07/'25 van 8:38 tot 12:52

sudo apt-get dist-upgrade

Last login: Fri Jul 11 12:38:42 2025 from 91.183.109.216
admin@ip-172-34-4-185:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 22.04.5 LTS
Release: 22.04
Codename: jammy

MySQL Server

Issue

sudo dpkg -i mysql-apt-config_0.8.33-1_all.deb
(Reading database ... 155420 files and directories currently installed.)
Preparing to unpack mysql-apt-config_0.8.33-1_all.deb ...
Unpacking mysql-apt-config (0.8.33-1) over (0.8.33-1) ...
Setting up mysql-apt-config (0.8.33-1) ...

The following packages have unmet dependencies:
 mysql-common : Conflicts: mysql-client-8.0 but 8.0.42-0ubuntu0.22.04.2 is to be installed
 Conflicts: mysql-client-core-8.0 but 8.0.42-0ubuntu0.22.04.2 is to be installed
 mysql-server : Depends: mysql-server-8.0 but it is not installable
E: Unable to correct problems, you have held broken packages.

admin@ip-172-34-4-185:~$ sudo apt update && sudo apt install mysql-server
Get:1 http://repo.mysql.com/apt/ubuntu focal InRelease [12.8 kB]
Get:2 http://repo.mysql.com/apt/ubuntu focal/mysql-8.0 Sources [961 B]
Get:3 http://repo.mysql.com/apt/ubuntu focal/mysql-apt-config amd64 Packages [566 B]
Get:4 http://repo.mysql.com/apt/ubuntu focal/mysql-8.0 amd64 Packages [10.7 kB]
Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease
Get:6 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
Get:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB]
Ign:8 http://security.ubuntu.com/ubuntu impish-security InRelease
Get:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB]
Err:10 http://security.ubuntu.com/ubuntu impish-security Release
 404 Not Found [IP: 91.189.91.81 80]
Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2723 kB]
Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1221 kB]
Reading package lists... Done
E: The repository 'http://security.ubuntu.com/ubuntu impish-security Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

Solution

wget https://dev.mysql.com/get/mysql-apt-config_0.8.34-1_all.deb
sudo dpkg -i mysql-apt-config_0.8.34-1_all.deb 
ls -rtl
whereis mysql
cd /usr
cd bin
ls
sudo ./mysql
cd $HOME
sudo apt install mysql-server
sudo shutdown -r now

Maar...

• de gedownloade was 0.8.34
• maar als ik mysql -V doe, krijg ik 8.0.42

https://ace.ste.nl/ en https://www.ace.hu.nl/

• https://ace.ste.nl/
• https://ace.ste.nl/sessions.html
• https://www.explio.com/ste/

• https://www.ace.hu.nl/
• https://www.ace.hu.nl/sessions.html
• https://www.explio.com/hu/

List updated packages

cat /var/log/dpkg.log | grep "\ install\ "
2025-07-11 08:37:00 install ubuntu-pro-client:amd64 <none> 36ubuntu0~22.04
2025-07-11 08:37:01 install ubuntu-pro-client-l10n:amd64 <none> 36ubuntu0~22.04
2025-07-11 08:37:04 install libxcb-randr0:amd64 <none> 1.14-3ubuntu3
2025-07-11 08:37:06 install python3-packaging:all <none> 21.3-1
2025-07-11 12:48:55 install mysql-client:amd64 <none> 8.0.42-1ubuntu20.04
2025-07-11 12:48:55 install mysql-community-server:amd64 8.0.33-1ubuntu20.04 8.0.42-1ubuntu20.04
2025-07-11 12:48:55 install mysql-server:amd64 <none> 8.0.42-1ubuntu20.04

Environments that will/won't switch to server 102 on 16/09/2023

environment	switch	ok
demo	16/09/2023
dev	16/09/2023
digwb	16/09/2023
elan	16/09/2023
hu	07/10/2023
hybrid	16/09/2023
ilearn	16/09/2023
ste	04/10/2023

Scheduled tasks

Plain text

• dagelijkse backup vd ace3-db's om 3.30u
• om de 2 minuten digwb login pingen, indien niet in orde, herstart apache
• backup wiki + svn dagelijks om 1.30u
• monitor pxl om 00u, 11u, 20u, om 3.40u, 12.40u, 23.40u, en om 7.20u en 16.20u (geen idee waarom ik die tijdstippen heb gekozen...)
• check of het demo-wachtwoord werd gewijzigd, dagelijks om 23.58u
• archiveer intakes van STE die ouder zijn dan een jaar, dagelijks om 4u

crontab

Still to do

What is it?

lsb_release -a

• UFW or Uncomplicated Firewall
  • momenteel niet actief (sudo ufw status)
  • MySQL: niet geconfigureerd
  • Apache: wel geconfigureerd

Keys

• Session > Host Name / IP address: 52.208.41.170
• Window > Behaviour > Window title: server...
• Windows > Colours > Default Background: choose a distinctive colour
• Connection > Data > Login details - Auto-login username: ubuntu
• Connection > SSH > Auth > Credentials > Private key file for authentication: C:\UserKeys\explio-aws102.ppk.

tijdelijk

hosts file entries

52.208.41.170 explio.com # server102
52.208.41.170 www.explio.com # server102
52.208.41.170 www.ace.hu.nl # server102
52.208.41.170 ace.ste.nl # server102

styles

body {
   background-color:#dae5fb;
}

set timezone

sudo timedatectl set-timezone Europe/Paris

timedatectl

admin user creation

sudo adduser admin --ingroup sudo

sudo groupadd admin

sudo usermod -g admin admin

cd /home/ubuntu
tar cf - . | (cd ../admin;tar xf -)
chown -R admin:admin /home/admin

vi /etc/sudoers.d/90-cloud-init-users

admin ALL=(ALL) NOPASSWD:ALL

• als admin sudo su doen zonder wachtwoordprompt
• Become super user / root in !WinSCP
  
  • Go to your WinSCP profile (Session > Sites > Site Manager)
  • Click on Edit > Advanced… > Environment > SFTP
  • Insert sudo su -c /usr/lib/sftp-server in "SFTP Server" (note this path might be different in your system)
  • Save and connect

Cannot initialize SFTP protocol. Is the host running a SFTP server?

Adapt A records and SPF records in Telenet MyCloud

• Domainnamen: explio.com
• Resource Records tab:
  • A-records: +
    • Hostnaam: server102.explio.com
    • IP-adres: 52.208.41.170
  • SPF-records: breid de bestaande SPF-record uit met ip4:52.208.41.170
• wiki:
  • AwsServers
  • TelenetMyCloud

copy files

/home/admin/.ssh/explio-aws101.pem

mkdir /srv/setup/xfer
cd /srv/setup/xfer

sudo su
scp -p -r -i /home/admin/.ssh/explio-aws101.pem admin@172.34.12.13:/home/admin/testdir .

• -p: preserve modification time, access time, file mode (niet te verwarren met hoofdletter -P, dat is voor een alternatief poortnummer, standaard is 22)
• -r: recursively copy directories
• -i: identity file

rsync -Pav -e "ssh -i /home/admin/.ssh/explio-aws101.pem" admin@172.34.12.13:/srv/backups . > rsync.backups.log
rsync -Pav -e "ssh -i /home/admin/.ssh/explio-aws101.pem" admin@172.34.12.13:/srv/cgi-bin . > rsync.cgi-bin.log
rsync -Pav -e "ssh -i /home/admin/.ssh/explio-aws101.pem" admin@172.34.12.13:/srv/conf . > rsync.conf.log
rsync -Pav -e "ssh -i /home/admin/.ssh/explio-aws101.pem" admin@172.34.12.13:/srv/htdocs . > rsync.htdocs.log
rsync -Pav -e "ssh -i /home/admin/.ssh/explio-aws101.pem" admin@172.34.12.13:/srv/tools . > rsync.tools.log

cd /srv
sudo tar -czvf wildfly.tar.gz wildfly-10.1.0.Final/

rsync -Pav -e "ssh -i /home/admin/.ssh/explio-aws101.pem" admin@172.34.12.13:/srv/wildfly.tar.gz . > rsync.wildfly.log

tar -xf wildfly.tar.gz

• -x: extract
• -f: file name

rm -R standalone-*/log/*

sudo cp -R ../setup/xfer/wildfly-10.1.0.Final/standalone-demo/ ./standalone-demo/

clean demo

ace3 environments setup

chown -R admin:admin srv

01 Java

01.a Java 8

sudo apt-get update
sudo apt-get install openjdk-8-jre
cd /usr/lib/jvm
sudo ln -s java-1.8.0-openjdk-amd64 default-java

java -version

openjdk version "1.8.0_362"
OpenJDK Runtime Environment (build 1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09)
OpenJDK 64-Bit Server VM (build 25.362-b09, mixed mode)

01.b Java 17

java -version

openjdk version "17.0.9" 2023-10-17
OpenJDK Runtime Environment (build 17.0.9+9-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 17.0.9+9-Ubuntu-122.04, mixed mode, sharing)

02 MySQL

mysql -V
mysql Ver 8.0.33 for Linux on x86_64 (MySQL Community Server - GPL)

MySQL Workbench

• SSH
  • Tunnels
    Source port: 23306 - Destination: localhost:3306 (database)

Modifications my.cnf

SET TIME_ZONE

• sudo vi /etc/mysql/mysql.cnf
• Onderaan toevoegen:
  [mysqld]
  default-time-zone='Europe/Paris'
• restart mysql server:
  sudo systemctl restart mysql

SET MAX_ALLOWED_PACKET

• sudo vi /etc/mysql/mysql.cnf
• Onderaan toevoegen, in de sectie [mysqld]:
  max_allowed_packet=1024M
  op 28/01/2026 nogmaals verhoogd: max_allowed_packet=2048M
  en dezelfde dag nog teruggezet op 1024M nadat ik de boosdoenende mediafile had verwijderd
• restart mysql server:
  sudo systemctl restart mysql

Secure local password

03 WildFly

• /home/admin/.bash_aliases gekopieerd van server101 naar server102
• sudo reboot
• .bashrc van de user pikt de .bash_aliases automatisch op

04 Apache + mod_jk

• Gewoon gekopieerd van server101
• /srv/conf/server101.conf => server102.conf

Apache 2.4 MPM worker settings

/etc/apache2/mods-enabled/mpm_worker.conf	default (used for digwb)
MaxConnectionsPerChild	0
MaxRequestWorkers	150
MaxSpareThreads	75
MinSpareThreads	25
StartServers	2
ThreadLimit	64
ThreadsPerChild	25

05 sendmail

06 ace3 instances

Add ejbclient user

demo

sudo vi /etc/sysctl.conf

net.core.rmem_max = 25480000
net.core.wmem_max = 25480000

sudo sysctl -p

dev - digwb - elan - hu - hybrid - ilearn - ste

• databases restoren
• applicatieserver restoren
• service laten automatisch starten

cd /srv/backups/ace3
gzip -d daily-digwb_*.gz
mysql --login-path=admin -e "create database digwb_content";
mysql --login-path=admin digwb_content < daily-digwb_content.sql
mysql --login-path=admin -e "create database digwb_domain";
mysql --login-path=admin digwb_domain < daily-digwb_domain-1.sql
cd /srv/wildfly
sudo cp -R ../setup/xfer/wildfly-10.1.0.Final/standalone-elan/ ./standalone-elan/
permissions elan
clean elan
sudo update-rc.d wildfly-elan defaults
start elan
sudo reboot

Finetuning

keep ssh connection alive

ClientAliveInterval 120

log files: redirecten en roteren in /var/log

ln -s ../wildfly/standalone-demo/log demo-logs

cron

• alleen voor user admin
• niet voor user root

sudo apt-get install mailutils

SERVER=server102

cgi-bin

admin@ip-172-34-4-185:/srv/cgi-bin/www.explio.com/login$ ./digwb.cgi
Can't locate CGI.pm in @INC (you may need to install the CGI module) (@INC contains: /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.34.0 /usr/local/share/perl/5.34.0 /usr/lib/x86_64-linux-gnu/perl5/5.34 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl-base /usr/lib/x86_64-linux-gnu/perl/5.34 /usr/share/perl/5.34 /usr/local/lib/site_perl) at ./digwb.cgi line 3.
BEGIN failed--compilation aborted at ./digwb.cgi line 3.

sudo find / -name CGI.pm -print 2>/dev/null

# sudo apt-get update
# sudo apt-get install libcgi-pm-perl

/srv/cgi-bin/www.explio.com/login/digwb.cgi

• u = user
• p = password
• l = language (optioneel, standaard 'nl_BE')

https://www.explio.com/login/digwb.cgi?u=sbo&p=h***5

=HYPERLINK("https://www.explio.com/login/digwb.cgi?u="&H285&"&p="&SUBSTITUTE(SUBSTITUTE(I285;"%";"%25");"+";"%2B")&"")

Accentletters

binmode STDOUT, ":utf8";

binmode STDOUT, ":iso-8859-1";

Disable "You have no mail." message at login

# session optional pam_mail.so standard noenv # [1]
session optional pam_mail.so quiet noenv # [1]

Varia

• backup (en andere scripts, monitoring bv.): oké, werken ze?
• logrotate (/var/log/wildfly)
• cgi-bin scripts testen
• apache configuratie: alles wat niet ace3 is eruit gooien
• setup .txt-bestanden terug kopiëren
• delete wilfdfly.tar.gz op server101
• website www.explio.com
• wiki

MPM worker settings

Disk space

• 12/01/2026 - voor het verwijderen van oude logfiles: 78GB gebruikt vd 97GB totaal = 80% = OK
• 12/01/2026 - na het verwijderen van oude logfiles: 76GB gebruikt vd 97GB totaal = 78% = OK

Beveiligde mappen website

AuthType Basic
AuthName "eXplio Download Area"
AuthUserFile /srv/conf/users
AuthGroupFile /srv/conf/groups
Require group explio kleurrijker

AuthType Basic
AuthName "eXplio Downloads Area"
AuthUserFile /srv/conf/users
AuthGroupFile /srv/conf/groups
Require user blauw

admin@ip-172-34-9-243:~$ which htpasswd
/usr/bin/htpasswd
admin@ip-172-34-9-243:~$ cd /usr
admin@ip-172-34-9-243:/usr$ cd bin
admin@ip-172-34-9-243:/usr/bin$ ./htpasswd -c /srv/conf/passwd blauw
New password:
Re-type new password:
Adding password for user blauw

blauw:$ge3$ncrypte3rd$wachtw00rd

downloads: blauw

JVM

admin@ip-172-34-12-13:~$ java -XX:+PrintFlagsFinal -version | grep Metaspace
 uintx InitialBootClassLoaderMetaspaceSize = 4194304              {product}
 uintx MaxMetaspaceExpansion               = 5451776              {product}
 uintx MaxMetaspaceFreeRatio               = 70                   {product}
 uintx MaxMetaspaceSize                    = 18446744073709547520 {product}
 uintx MetaspaceSize                       = 21807104             {pd product}
 uintx MinMetaspaceExpansion               = 339968               {product}
 uintx MinMetaspaceFreeRatio               = 40                   {product}
 bool UseLargePagesInMetaspace             = false                {product}

SVN

Logs

daemon.log

Disk usage

• Total Disk Size: 97G
• Disk Size · Used Space: 87G
• Disk Size · Free Space: 11G

sudo du -sh * | sort -h

• /home (downloads, caches, user files)
• /var (zware logs in /var/log, db files)
• /usr: geïnstalleerde software, libraries, binaries
• /tmp: tijdelijke bestanden die niet opgeruimd werden

Systeemlogging beperken

sudo vi /etc/systemd/journald.conf

SystemMaxUse=500M

sudo systemctl restart systemd-journald

• Total Disk Size: 97G
• Disk Size · Used Space: 83G
• Disk Size · Free Space: 14G

• Total Disk Size: 97G
• Disk Size · Used Space: 83G
• Disk Size · Free Space: 15G

rm -rf $HOME/.cpan/build/*
rm -rf $HOME/.cpan/sources/authors/id
rm -rf $HOME/.cpan/cpan_sqlite_log.*

• Total Disk Size: 97G
• Disk Size · Used Space: 82G
• Disk Size · Free Space: 16G

algemene logs comprimeren die ouder zijn dan 3 dagen

cd /srv/logs
find . -mtime +3 -print -exec gzip {} \;

0 2 * * * /home/admin/scripts/compress_old_logs.sh >> /dev/null 2>&1

sudo sh -c 'rm -rf /var/lib/snapd/cache/*'