Hi, I'm getting parsing error and in the GUI only the below empty column shows up

GSM only (< Rel-4)
GSM only (>= Rel-4)
3G and beyond / GSM (R99 and later)

Error while running bundl exec:

Rel-16
Rel-17
Creating document 01.02: 'General Description of a GSM Public Land Mobile Network (PLMN)'
Error while parsing 1: undefined local variable or method e' for main:Object Creating document 01.04: 'Abbreviations and acronyms' Error while parsing 2: undefined local variable or method e' for main:Object
Creating document 01.31: 'Fraud Information Gathering System (FIGS); Service requirements; Stage 0'
Error while parsing 3: undefined local variable or method e' for main:Object Creating document 01.33: 'Lawful Interception requirements for GSM' Error while parsing 4: undefined local variable or method e' for main:Object
Creating document 01.48: 'ISDN-based DECT/GSM interworking; Feasibility study'
Error while parsing 5: undefined local variable or method e' for main:Object Creating document 01.56: 'GSM Cordless Telephony System (CTS) (Phase 1); CTS Authentication and Key Generation Algorithms Requirements' Error while parsing 6: undefined local variable or method e' for main:Object
Creating document 01.60: 'GPRS requirements'
Error while parsing 7: undefined local variable or method e' for main:Object Creating document 01.61: 'General Packet Radio Service (GPRS); GPRS ciphering algorithm requirements' Error while parsing 8: undefined local variable or method e' for main:Object
Creating document 02.01: 'Principles of telecommunication services supported by a GSM Public Land Mobile Network(PLMN)'
Error while parsing 9: undefined local variable or method e' for main:Object Creating document 02.02: 'Bearer Services (BS) Supported by a GSM Public Land Mobile Network (PLMN)' Error while parsing 10: undefined local variable or method e' for main:Object
Creating document 02.03: 'Teleservices Supported by a GSM Public Land Mobile Network (PLMN)'
Error while parsing 11: undefined local variable or method e' for main:Object Creating document 02.04: 'General on Supplementary Services' Error while parsing 12: undefined local variable or method e' for main:Object
Creating document 02.06: 'Types of Mobile Stations (MS)'
Error while parsing 13: undefined local variable or method `e' for main:Object

I'm using this issue to document my setup. Just running
docker run --name spex -p 80:80 corfr/spex
didn't work for me, e.g., the production environment requires a mysql host in place.

Docker Setup

The docker image is available as corfr/spex or from sources:

host:spex$ docker build -t spex .

Spex stores all downloaded content on disk, and maintains an index in a mysql database. First, set up the mysql server:

host:~$ docker network create spex-net
host:~$ docker run --name spex-mysql --network spex-net -e MYSQL_ROOT_PASSWORD=spex -d mysql:latest

Connect to the mysql machine and create a database:

host:~$ docker run -it --network spex-net --rm mysql mysql -hspex-mysql -uroot -p
# (mysql is automatically started)
mysql> CREATE DATABASE spex;

Now we can start spex and point it to the MySQL database.

host:~$ docker run --name spex --network spex-net -e MYSQL_ENV_DB_NAME=spex -e MYSQL_ENV_DB_USER=root -e MYSQL_ENV_DB_PASS=spex -e MYSQL_PORT_3306_TCP_ADDR=spex-mysql -p 3000:80 corfr/spex

On first run, you'll need to manually populate the database:

host:~$ docker exec -ti spex bash
spex:~$ cd /home/app/webapp
spex:webapp$ bundle exec rake db:setup
# if the database cannot be manipulated, first disable the security checks and re-execute above command
spex:webapp$ export DISABLE_DATABASE_ENVIRONMENT_CHECK=1

The spex website is now available on http://localhost:3000

in the HTML-converted spec, clicking on a page yields an URL with some page anchor encoded at the very end: /specs/24/24_010/v15_0_0.html#[10,%22FitH%22,501]

It seems the pdf2html JS only appends the data to the URL, but never evaluates the data when you click on a link. In this example, the browser should jump to page 10. That'd be great for bookmarks and sharing links to some specific (TS+version+section).

Would be great to

• fix the JS and enable bookmarks
• introduce another anchor format that includes the Section

Hi,

while retrieving .doc file works well for latest release (e.g. rel-16) it looks like that no converter towards pdf or html is implemented. Hence html is only available for older versions (e.g. rel-15).

Do you have any plans to implement converter to html from .doc version of spec?
Do you have any more detailed docu that might enlighten me to contribute to this project?

Cheers/T

script/init_3gpp.rb doesn't run for me, just did docker-compose build and docker-compose up. When manually invoking the script, it throws some errors:

                Creating version {:major=>4, :technical=>0, :editorial=>1}
Error while parsing 3049: You cannot call create unless the parent is saved
        Creating document 43.030: 'Radio network planning aspects'
        Unable to create document for 43.030: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>1, :editorial=>0}
Error while parsing 3050: You cannot call create unless the parent is saved
        Creating document 43.033: '3G security; Lawful Interception; Stage 2'
        Unable to create document for 43.033: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>0, :editorial=>0}
Error while parsing 3051: You cannot call create unless the parent is saved
        Creating document 43.045: 'Technical realization of facsimile group 3 transparent'
        Unable to create document for 43.045: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>0, :editorial=>0}
Error while parsing 3052: You cannot call create unless the parent is saved
        Creating document 43.050: 'Transmission planning aspects of the speech service in the GSM Public Land Mobile Network (PLMN) system'
        Unable to create document for 43.050: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>0, :editorial=>0}
Error while parsing 3053: You cannot call create unless the parent is saved
        Creating document 43.051: 'GSM/EDGE Overall description; Stage 2'
        Unable to create document for 43.051: Validation failed: Spec serie must exist
                Creating version {:major=>5, :technical=>10, :editorial=>0}
Error while parsing 3054: You cannot call create unless the parent is saved
        Creating document 43.052: 'GSM Cordless Telephony System (CTS), Phase 1; Lower Layers of the CTS Radio Interface, Stage 2'
        Unable to create document for 43.052: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>0, :editorial=>0}
Error while parsing 3055: You cannot call create unless the parent is saved
        Creating document 43.055: 'Dual Transfer Mode (DTM); Stage 2'
        Unable to create document for 43.055: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>6, :editorial=>0}
Error while parsing 3056: You cannot call create unless the parent is saved
        Creating document 43.058: 'Characterisation, test methods and quality assessment for handsfree Mobile Stations (MSs)'
        Unable to create document for 43.058: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>0, :editorial=>0}
Error while parsing 3057: You cannot call create unless the parent is saved
        Creating document 43.059: 'Functional stage 2 description of Location Services (LCS) in GERAN'
        Unable to create document for 43.059: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>7, :editorial=>0}
Error while parsing 3058: You cannot call create unless the parent is saved
        Creating document 43.064: 'General Packet Radio Service (GPRS); Overall description of the GPRS radio interface; Stage 2'
        Unable to create document for 43.064: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>5, :editorial=>0}
Error while parsing 3059: You cannot call create unless the parent is saved
        Creating document 43.068: 'Voice Group Call Service (VGCS); Stage 2'
        Unable to create document for 43.068: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>6, :editorial=>0}
Error while parsing 3060: You cannot call create unless the parent is saved
        Creating document 43.069: 'Voice Broadcast Service (VBS); Stage 2'
        Unable to create document for 43.069: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>5, :editorial=>0}
Error while parsing 3061: You cannot call create unless the parent is saved
        Creating document 43.073: 'Support of Localised Service Area (SoLSA); Stage 2'
        Unable to create document for 43.073: Validation failed: Spec serie must exist
                Creating version {:major=>4, :technical=>0, :editorial=>0}
Error while parsing 3062: You cannot call create unless the parent is saved
        Creating document 43.129: 'Packet-switched handover for GERAN A/Gb mode; Stage 2'
        Unable to create document for 43.129: Validation failed: Spec serie must exist
                Creating version {:major=>6, :technical=>13, :editorial=>0}
Error while parsing 3063: You cannot call create unless the parent is saved
        Creating document 43.130: 'GSM/EDGE Iur-g interface; Stage 2'
        Unable to create document for 43.130: Validation failed: Spec serie must exist
                Creating version {:major=>5, :technical=>0, :editorial=>0}
Error while parsing 3064: You cannot call create unless the parent is saved
        Creating document 43.246: 'Multimedia Broadcast/Multicast Service (MBMS) in the GERAN; Stage 2'
        Unable to create document for 43.246: Validation failed: Spec serie must exist
                Creating version {:major=>6, :technical=>10, :editorial=>0}
Error while parsing 3065: You cannot call create unless the parent is saved
        Creating document 43.318: 'Generic Access Network (GAN); Stage 2'
        Unable to create document for 43.318: Validation failed: Spec serie must exist
                Creating version {:major=>6, :technical=>12, :editorial=>0}
Error while parsing 3066: You cannot call create unless the parent is saved
        Creating document 43.801: 'Solutions for Voice services over Adaptive Multi-user channels on One Slot (VAMOS) enhancements'
        Unable to create document for 43.801: Validation failed: Spec serie must exist
                Creating version {:major=>12, :technical=>0, :editorial=>0}
Error while parsing 3067: You cannot call create unless the parent is saved
        Creating document 43.802: 'GERAN study on mobile data applications'
        Unable to create document for 43.802: Validation failed: Spec serie must exist
                Creating version {:major=>12, :technical=>0, :editorial=>0}
Error while parsing 3068: You cannot call create unless the parent is saved
        Creating document 43.868: 'GERAN improvements for Machine-Type Communications (MTC)'
        Unable to create document for 43.868: Validation failed: Spec serie must exist
                Creating version {:major=>12, :technical=>1, :editorial=>0}
Error while parsing 3069: You cannot call create unless the parent is saved
        Creating document 43.869: 'GERAN Study on power saving for MTC devices'
        Unable to create document for 43.869: Validation failed: Spec serie must exist
                Creating version {:major=>13, :technical=>0, :editorial=>0}
Error while parsing 3070: You cannot call create unless the parent is saved
        Creating document 43.901: 'Feasibility Study on generic access to A/Gb interface'
        Unable to create document for 43.901: Validation failed: Spec serie must exist
                Creating version {:major=>6, :technical=>0, :editorial=>0}
Error while parsing 3071: You cannot call create unless the parent is saved
        Creating document 43.902: 'Enhanced Generic Access Networks (EGAN) study'
        Unable to create document for 43.902: Validation failed: Spec serie must exist

Hi there,

while install via

$ bundle install

on RHEL 8.2 I run into the issue:

Installing cairo 1.16.4 with native extensions
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

current directory: /tmp/bundler20200518-80090-11x4alwcairo-1.16.4/gems/cairo-1.16.4/ext/cairo

/usr/bin/ruby -r ./siteconf20200518-80090-gpvo95.rb extconf.rb
checking for GCC... yes
checking for Homebrew... no
checking for cairo version (>= 1.2.0)... no
installing 'cairo-devel' native package... failed
Failed to run '/usr/bin/sudo -p [sudo]\ password\ for\ %u\ to\ install\ <cairo-devel>:\ dnf install --enablerepo=PowerTools -y cairo-devel'.
*** extconf.rb failed ***

Without going deeper into it - was anyone successful to install on RHEL 8.2 ? There is no such repo like 'PowerTools' available - and that can be seen as well in the log:

$ cat /home/__tpa/.gem/ruby/extensions/x86_64-linux/2.5.0/cairo-1.16.4/mkmf.log
checking for GCC... -------------------- yes

"gcc -o conftest -I/usr/include -I/usr/include/ruby/backward -I/usr/include -I. -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fPIC conftest.c -L. -L/usr/lib64 -L. -Wl,-z,relro -Wl,-z,now -specs=/usr/lib/rpm/redhat/redhat-hardened-ld -fstack-protector-strong -rdynamic -Wl,-export-dynamic -m64 -lruby -lc"
checked program was:
/* begin */
1: #include "ruby.h"
2:
3: int main(int argc, char *argv)
4: {
5: return 0;
6: }
/ end */

"gcc -I/usr/include -I/usr/include/ruby/backward -I/usr/include -I. -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fPIC -m64 -c conftest.c"
checked program was:
/* begin /
1: #include "ruby.h"
2:
3: /top/
4: #ifndef GNUC
5: # error
6: |:/ === GNUC undefined === /:|
7: #endif
/ end */

checking for Homebrew... -------------------- no

have_package: checking for cairo version (>= 1.2.0)... -------------------- no

"/usr/bin/sudo -p [sudo]\ password\ for\ %u\ to\ install\ <cairo-devel>:\ dnf install --enablerepo=PowerTools -y cairo-devel"
Updating Subscription Management repositories.
Fehler: Unbekannte Paketquelle: »PowerTools«
installing 'cairo-devel' native package... failed
Failed to run '/usr/bin/sudo -p [sudo]\ password\ for\ %u\ to\ install\ <cairo-devel>:\ dnf install --enablerepo=PowerTools -y cairo-devel'.

Any hints?

Hi,

meanwhile I set up on Ubuntu and managed to get the containers up and access the webserver (much easier than in RHEL, where I still cant access the localhost:3000). When I now try to run:
spex:webapp$ bundle exec /home/app/webapp/script/init_3gpp.rb

I experience after ~330 sec an issue with:
Creating document 55.919: '3G Security; Specification of the A5/3 encryption algorithms...

I assume due to the 'slash' in the title (?). Then the script fails and stops loading further:

Creating document 55.243: 'Specification of the GIA4 integrity algorithm for General Packet Radio Service (GPRS); Design conformance test data'
	Creating version {:major=>14, :technical=>0, :editorial=>0}
	Creating version {:major=>15, :technical=>0, :editorial=>0}
Creating document 55.251: 'Specification of the GEA5 and GIA5 encryption algorithms for General Packet Radio Service (GPRS); GEA5 and GIA5 algorithm specification'
	Creating version {:major=>14, :technical=>0, :editorial=>1}
	Creating version {:major=>15, :technical=>0, :editorial=>0}
Creating document 55.252: 'Specification of the GEA5 encryption and GIA5 integrity algorithms for General Packet Radio Service (GPRS); Implementers' test data'
	Creating version {:major=>14, :technical=>0, :editorial=>0}
	Creating version {:major=>15, :technical=>0, :editorial=>0}
Creating document 55.253: 'Specification of the GEA5 encryption and GIA5 integrity algorithms for General Packet Radio Service (GPRS); Design conformance test data'
	Creating version {:major=>14, :technical=>0, :editorial=>0}
	Creating version {:major=>15, :technical=>0, :editorial=>0}
**Creating document 55.919: '3G Security; Specification of the A5/3 encryption algorithms for GSM and ECSD, and the GEA3 encryption algorithm for GPRS; Document 4: Design and evaluation report'
	Creating version {:major=>3, :technical=>0, :editorial=>0}
	Creating version {:major=>4, :technical=>0, :editorial=>0}
	Creating version {:major=>5, :technical=>0, :editorial=>0}
	Creating version {:major=>6, :technical=>2, :editorial=>1}
	Creating version {:major=>7, :technical=>1, :editorial=>0}
	Creating version {:major=>8, :technical=>0, :editorial=>0}
	Creating version {:major=>9, :technical=>0, :editorial=>0}
	Creating version {:major=>10, :technical=>0, :editorial=>0}
	Creating version {:major=>11, :technical=>0, :editorial=>0}
	Creating version {:major=>12, :technical=>0, :editorial=>0}
	Creating version {:major=>13, :technical=>0, :editorial=>0}
	Creating version {:major=>14, :technical=>0, :editorial=>0}
	Creating version {:major=>15, :technical=>0, :editorial=>0}

Error while parsing 3119: Unable to parse 'TBR 5'
Error while parsing 3120: Unable to parse 'TBR 9'
Error while parsing 3121: Unable to parse 'TBR19'
Error while parsing 3122: Unable to parse 'TBR20'
Error while parsing 3123: Unable to parse 'TBR31'
Error while parsing 3124: Unable to parse 'TBR32'**
... took 331.19 sec

app@46c08e5f2196:/home/app/webapp$

Any way how to fix that?

Thx,
T

Regarding the broken pdf2html (commit c1a1033), this issue seems relevant: pdf2htmlEX/pdf2htmlEX#42

In short, they say that pdf2htmlEX doesn't work with recent fontforge. Building the last 2017 fontforge release wasn't straightforward.

Docker released a preview version for Apple M1 platforms. The public instance (http://spex.cor-net.org) is down at the time of writing this, so I attempted to spin up a local instance. It could be a Docker/Apple M1 issue, but jotting it down here.

Logs

 ~/ docker run --name spex-mysql --platform linux/amd64 --network spex-net -e MYSQL_ROOT_PASSWORD=spex -d mysql:latest
 # OK

 ~/ docker pull corfr/spex --platform linux/amd64
# OK

 ~/ docker run -it --network spex-net --rm mysql mysql -h spex-mysql -u root -p
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 8
Server version: 8.0.25 MySQL Community Server - GPL

Copyright (c) 2000, 2021, Oracle and/or its affiliates.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> CREATE DATABASE spex;
Query OK, 1 row affected (0.04 sec)

mysql> exit
Bye

 ~/ docker run --name spex --network spex-net -e MYSQL_ENV_DB_NAME=spex -e MYSQL_ENV_DB_USER=root -e MYSQL_ENV_DB_PASS=spex -e MYSQL_PORT_3306_TCP_ADDR=spex-mysql -v spex-storage:/home/app/webapp/specs -p 3000:80 corfr/spex
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
*** Running /etc/my_init.d/00_regen_ssh_host_keys.sh...
*** Running /etc/my_init.d/10_syslog-ng.init...
May 13 18:44:48 7d24b89feefa syslog-ng[30]: syslog-ng starting up; version='3.13.2'
*** Running /etc/my_init.d/30_presetup_nginx.sh...
*** Running /etc/my_init.d/webapp.sh...
`` is not a directory.
Bundler will use `/tmp/bundler20210513-90-ha5sda90' as your home directory temporarily.
/usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/spec_set.rb:88:in `block in materialize': Could not find concurrent-ruby-1.1.5 in any of the sources (Bundler::GemNotFound)
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/spec_set.rb:82:in `map!'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/spec_set.rb:82:in `materialize'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/definition.rb:170:in `specs'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/definition.rb:240:in `specs_for'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/definition.rb:222:in `requested_specs'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/runtime.rb:91:in `block in definition_method'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/runtime.rb:20:in `setup'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler.rb:148:in `setup'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/setup.rb:20:in `block in <top (required)>'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/ui/shell.rb:136:in `with_level'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/ui/shell.rb:88:in `silence'
	from /usr/local/rvm/gems/ruby-2.6.6/gems/bundler-2.2.9/lib/bundler/setup.rb:20:in `<top (required)>'
	from /usr/local/rvm/rubies/ruby-2.6.6/lib/ruby/2.6.0/rubygems/core_ext/kernel_require.rb:54:in `require'
	from /usr/local/rvm/rubies/ruby-2.6.6/lib/ruby/2.6.0/rubygems/core_ext/kernel_require.rb:54:in `require'
*** /etc/my_init.d/webapp.sh failed with status 1

*** Killing all processes...
May 13 18:44:54 7d24b89feefa syslog-ng[30]: syslog-ng shutting down; version='3.13.2'