Commit Graph

22 Commits

Author SHA1 Message Date
willox
1304424600 windows node bootstrapping now downloads node.exe to a separate file before renaming it (#73586)
This should stop people from getting "corrupt" copies of node.exe in
their `./tools/bootstrap/.cache` directory. I checked before making this
commit that WebClient.DownloadFile can definitely result in a
half-written file.
2023-02-23 23:52:48 -07:00
Zephyr
41c7c1136c Fix Pip for Bootstrap (#72488)
Mothblocks forgot to update the bootstrap script to the new python
version when they changed the python dependency version

That path descriptor file is now automatically generated during
bootstrap, which will prevent this issue from happening again in the
future, unless they change the path descriptor format
2023-01-06 20:54:37 +00:00
William Wallace
3c36bd210c Change NodeJS on Windows to 64-bit, downgrade to v14.16.1 (#64513)
* Change bootstrapped NodeJS on Windows from 32-bit to 64-bit

* Last node version to support Win7

* Skip platform check

Co-authored-by: Aleksej Komarov <stylemistake@gmail.com>
2022-01-29 20:02:49 +02:00
Aleksej Komarov
197a2de5f7 Always use vendored NodeJS on Windows (#64461)
As @SpaceManiac said:

    A big part of the point of the bootstrap scripts is to provide a reproducible environment

Here I am, web-removing the bit of code that allows using a system-wide version of NodeJS. Now we're vendored only.
2022-01-28 17:19:43 +00:00
AnturK
a1598e181c Bumps bootstrapped python version to 3.7.9 (#64246)
From quick test all our helper scripts work fine on 3.7.
Why 3.7.9 instead of latest 3.7.12 ? Embed zips for these versions are missing from python.org ftp. (They apparently do not ship binaries for security-fix only releases)
2022-01-19 12:51:41 -08:00
Aleksej Komarov
a7753ad6fd Juke Build 0.9.0 (#61005)
* Juke Build 0.9.0

* Fix a small bug with build.js

* Distill cmds

* Return sonar

* Revert those build.cmd changes

* Some improvements

* Treat all sonar warnings as errors because they should fail the sonar target

* Do not clean up bootstrap cache because it locks up on removing it
2021-08-25 16:09:00 +02:00
Aleksej Komarov
ad3ef5c803 Juke Build 0.8.1 Hotfix 1 (#60897)
* Juke Build 0.8.1 Hotfix 1

* Do not restore Yarn cache on just DM build
2021-08-16 20:58:28 +03:00
Aleksej Komarov
e5ae0667bf Juke Build 0.8.1 (#60404) 2021-08-15 15:17:11 -07:00
Aleksej Komarov
d200efc293 Juke Build Hotfix 2 - PreCompile script compatibility (#59649)
* Juke Build Hotfix 2 - PreCompile script compatibility

* Pass arguments from bat to build.js

* Pass arguments in BUILD.bat as well

* Quick tweak
2021-06-14 09:30:59 +12:00
AnturK
3d19fd4edf Fixes build script failing properly on windows. (#57623) 2021-03-11 19:46:06 +02:00
Aleksej Komarov
9c9cdfac8a Check node version in CBT (#57461) 2021-03-06 14:42:37 -08:00
Aleksej Komarov
21d5a65346 Fix a number of build issues (#57251)
* Fix finding of dreamseeker instances and not die on cache copy failures

* Upgrade dependencies, resolve webpack dependencies explicitly

* Preload tgui asset to fix reloading of a not yet sent tgui asset

* Rewrite node bootstrap and DM build task

* Redundant array accessor

* Add install-state.gz to tgui build dependencies

* Update build.js

* Use a proper dmlang vscode var
2021-02-28 14:24:34 +01:00
Aleksej Komarov
971b3e4ff3 Simplified Node Bootstrap mk. II (#56797)
Script tools/bootstrap/node_.ps1 will now only download a single node.exe file (32-bit variant) and nothing more.
Since we don't need to unzip, we removed a dependency on a .NET component.
Removed logging, because TGS4 already logs stdout/err, while all this fancy output redirection breaks on older PowerShell versions.
node.bat uses a system-wide node exe if available
CBT will not mislead users by printing things like "missing tgstation.dmb"
2021-02-11 16:17:47 -03:00
Jordan Brown
f7cf0e444a Revert "Simplify Node bootstrapping (#56713)" (#56747)
This reverts commit 917d5d48c4.
2021-02-07 13:47:15 -08:00
Aleksej Komarov
917d5d48c4 Simplify Node bootstrapping (#56713)
Fixes #56676 (can't test because author didn't answer my inquiries on discord)

- Script `tools/bootstrap/node_.ps1` will now only download a single `node.exe` file (32-bit variant) and nothing more.
- Since we don't need to unzip, we removed a dependency on a .NET component.
- Removed logging, because TGS4 already logs stdout/err, while all this fancy output redirection breaks on older PowerShell versions.
- `node.bat` uses a system-wide node exe if available
- CBT will not mislead users by printing things like "missing tgstation.dmb"
2021-02-07 14:19:24 -05:00
AnturK
4ea16463a3 Adds powershell require command to node boostrap script. (#56429) 2021-01-29 14:42:46 +08:00
windarkata
21c63e645c Add error handling for build tool (#56195)
* add some error handling for build tool

* Cosmetic changes

Co-authored-by: windarkata <windarkata@users.noreply.github.com>
Co-authored-by: Aleksej Komarov <stylemistake@gmail.com>
2021-01-19 08:37:51 +02:00
Tad Hardesty
8ca761670d Fix Docker build failing on a clean checkout (#56190)
Follow-up to #56175 which turned out to be accidentally relying on Node already being downloaded.
2021-01-15 23:23:40 -03:00
Aleksej Komarov
ec97a9da94 Force UTF-8 encoding in tools/bootstrap/node_.ps1 (#56177) 2021-01-15 15:27:59 +02:00
Aleksej Komarov
a5d362ce84 Common Build Tooling (#55373)
Add Common Build Tooling

## Information for Developers

On Windows, the build scripts will automatically install Node. Other 
platforms should use their package manager or download it from 
https://nodejs.org/en/download/

Pick one:

- VSCode: `Ctrl+Shift+B`
- VSCode: `F5` (build & run with debugger) or `Ctrl+F5` (build & run 
  without debugger)
- Windows: double-click root `Build.bat` (pause to see output) or 
  `tools/build/build.bat` (no pause)
- Git Bash and non-Windows: `tools/build/build`

## Information for Server Admins

- TGS scripts will automatically install the version of Node specified 
  in `dependencies.sh`
- Either use this build script, or compile tgui by running any script 
  in `tgui/bin` folder.

## Details

Both dm and tgui are now built with a single script. It's pretty easy 
to launch: just press `Ctrl+Shift+B` in VSCode, and tada! 🎉 

**It's smart.** It will skip certain steps if source files were 
untouched for that step. So, if you're only touching dm code, it will 
only rebuild dm code, and will skip tgui.

**Syntax is fairly readable and maintainable.**

```js
const { Task, runTasks, exec } = require('./cbt');

const taskTgui = new Task('tgui')
  .depends('tgui/yarn.lock')
  .depends('tgui/packages/**/*.js')
  .provides('tgui/public/*.bundle.*')
  .provides('tgui/public/*.chunk.*')
  .build(async () => {
    await exec('tgui/bin/tgui');
  });

runTasks([taskTgui]);
```

**This is a long term solution to the js bundle hell.** Now that we 
have a single script to build everything, bundles have been excluded 
from the repo, and they will no longer cause conflicts in PRs. This 
results in quicker PR turnaround time and less time wasted on 
rebuilding tgui for PRs.

**CI pipelines have been updated.** They're not coded in the most 
optimal way, just making them green for now.

## Possible future work

- Support compiling with DM defines by passing them as an argument, 
  like `-D LOWMEMORYMODE`.
- Instead of explicitly listing the task sequence in `runTasks()`, 
  support specifying tasks in `.depends()`, which in turn will allow 
  building a graph of dependencies and running things in parallel.

Co-authored-by: Tad Hardesty <tad@platymuus.com>

- Add root Build.bat
- Add trio of tools/bootstrap/ scripts for Node
- Add tools/build/README.md
- Ensure build script and VSC configuration works properly on Linux
- Update TGS4 PreCompile scripts

Co-authored-by: Jordan Brown <Cyberboss@users.noreply.github.com>

- Keep PreCompile scripts compatible with TGS3 as well
- Update LinuxOneShot PreCompile scripts
- Update TGS4 configuration
2021-01-14 10:39:38 -05:00
Gamer025
28fde3cb7c Fix wheel error for ci_suit workflow (#56053)
Adds wheel package since its required by some setup.py
Workflow run with this option added: https://github.com/Gamer025/tgstation/pull/1/checks?check_run_id=1672278250

Gets rid of all the
error: invalid command 'bdist_wheel'
errors in the ci_suite workflows
2021-01-10 11:52:02 -03:00
Tad Hardesty
67b4aa190e Use portable Python for map merge hooks, other tools (#55658)
* Add tools/bootstrap/python

* Add dependencies.sh entry for Python

* Use bootstrapped Python for HitboxExpander

* Use bootstrapped Python when installing hooks

Also:
- Adds tools/hooks/Uninstall.bat
- Removes the need to re-run Install.bat when a .hook file changes

Python path temporarily includes tools/mapmerge2 as before:
- PYTHONPATH in tools/hooks/python.sh handles Linux/virtualenv
- python36._pth handles Windows portable

* Move DMI merge driver to its own directory

* Use bootstrapped Python for makeChangelog.bat

* Set window title in bootstrap PS scripts

* Use slashes in hook paths

* Use relative imports in mapmerge2

* Use bootstrapped Python for mapmerge

* Update mapmerge2 readme

* Skip non-3way conflicts

* Fix relative path issue in posthoc merger

* Add missing call and %* to .bat files

* When installing hooks, don't uninstall them all first

* Make dependencies.sh POSIX

* Move update_paths.py to its own folder

* Use line buffering for Python stdout/stderr

It was switching to fully-buffered mode due to being piped, meaning we
wouldn't see output until the script ended. This is undesirable.

* Use new path to dmi.test in CI suite

* Validate system Python version in bootstrap script

* Add install advice to bootstrap script

* Update path to requirements.txt in CI

* Add upgrader for existing installations
2020-12-22 22:22:15 +01:00