Edit: I've decided to edit the title of this issue because the CPU usage eventually wasn't an issue and disappeared after a second boot. Main remaining issue now is the weird characters in the console, as shown here: https://i.imgur.com/u3mqwt3.png
https://timings.aikar.co/?id=be411c10e0ec4f0487d4c43b717a9578
So I have a server that has always run on Spigot 1.12.2 and it was working fine. However after some random crashes and googling I found Paper, and how it should be an improvement on Spigot.
However after booting paper instead of spigot and letting it run a while I see my CPU usage at 35%, with 1 player connected...? On Spigot this was 2-3%, my server is running on an i7-6700K @ 4GHz.
To elaborate, I'm using a server by VeryGames, running OpenMod. I have the spigot.jar in my root, so I just put the paper.jar in root too. Then I edited OpenMod and my AutoRestart plugin so it would boot paper, which seemed to work fine. It downloaded the server files on first boot, then booted normally.
Not to mention that my console is all messed up, with a weird "> [K" before every line and random numbers showing up: https://i.imgur.com/u3mqwt3.png
Edit: I just switched back to Spigot and my performance is back to what it used to be, CPU using about 3% with 1 player online.
AntiBuild
AntixXRayData
AuthMe
AutoMessager
AutoRestart
BetterRTP
bStats
ChatControl
ChopTree3
ClearLag
Essentials
FastAsyncWorldEdit
Genie
GriefPreventionData
Headslnventory
HeadsPluginAP|
HolographicDisplays
LogBlock
Multiverse-Core
Orebfuscator4
PermissionsEx
PerWorldinventory
Plan
PlayerMarkers
PluginMetrics
ProtocolLib
ServerListPlus
Shop
SilkSpawners
SkinsRestorer
SpigotUpdates
TouchscreenHolograms
update
update-confirm
Updater
Vault
WorldEdit
WorldGuard
bukkit.yml: https://pastebin.com/EyiEMvHv
spigot.yml: https://pastebin.com/ghrwqyt3
paper.yml: https://pastebin.com/0RrZLQCi
gitPaper-1616 (MC 1.12.2) (Implementing API version 1.12.2-R0.1-SNAPSHOT)
/timings on, wait 15 minutes or so while you experience lag, /timings paste -> give us the link. nothing we can do without that as there is no wait to actually look into your claims.
your console issue is a different issue, but since you have not provided any info about your system (os, os version, locale, terminal etc) we also can't help you there. for console issues it will most likely say something on the very top of your log.
Hi, thank you for the extra info. I'm completely new to paper so I didn't have much info on what was needed to troubleshoot. I'll try switching back to paper when there's less people online and provide the requested info.
I just launched paper again as there wasn't anyone online, and now the CPU usage seems to be normal, really weird. When I started paper for the very first time I made sure to at least keep it running for about half an hour to see if the CPU usage would go down, and it didn't. Then when switching back to spigot it dropped down to 3% again immediately. Maybe something that only happens on the very first boot?
Here's the timings link, everything seems fine from what I can see: https://timings.aikar.co/?id=be411c10e0ec4f0487d4c43b717a9578
About the console issues, this is at the top of my console:
BOOTLOADER: Starting Minecraft Server...
Loading libraries, please wait...
[15:44:26 INFO]: Starting minecraft server version 1.12.2
[15:44:26 INFO]: Loading properties
[15:44:26 INFO]: Default game type: SURVIVAL
[?1h=[?2004h› [K[15:44:26 INFO]: This server is running Paper version git-Paper-1616 (MC: 1.12.2) (Implementing API version 1.12.2-R0.1-SNAPSHOT)
› [K[15:44:26 INFO]: Server Ping Player Sample Count: 12
› [K[15:44:26 INFO]: Using 4 threads for Netty based IO
The issues seem to start right when it shows the version info. I would provide more info like server OS, version, etc. but I don't have that information. I rent a server from VeryGames and I can't really find info on what sort of software they use. They also offer a web terminal which I use to manage the server when I'm not playing. Any idea on how to get that info?
During startup, there is a looot going on, the JVM is still warming up, the server software itself is initializing a lot of state and plugins also generally pile up on the first few dozen ticks to perform other tasks
Timings itself is indicating that you didn't have a single lag tick in the sample you took, but having only a single CPU core is not good, especially for MC (The game is basically bound to a single core, yes; But: There are other threads that the server is using, making everything compete on a single core just compounds the issue of the game mostly being single threaded)
as for your terminal, not too sure what to suggest, it looks like your host is using some weird bootloader which hijacks the terminal, looks like the issues for you start as soon as jline kicks up, there are flags to forcefully disable this system and fall back to something that might be more forgiving for terminal implementations which are more dumb by using -Djline.terminal=true, however this requires modifying the startup flags
It's a pretty cheap server, I think I pay 7 euros per month for "unlimited RAM and slots", which probably means "until the CPU can't handle it anymore". Don't think I'm able to upgrade to a multi-core CPU without paying double that.
The bootloader is actually something I'm using myself. The server provider's autorestart system doesn't always work so I'm using AutoRestart which let's me start the bootloader using OpenMod through the server provider's system, and that then checks if my server is still running. If not it restarts it. It used to work fine under Spigot tho.
That part about Djline, you mean editing the startup parameters for paper.jar? Because of the bootloader I can actually edit those, otherwise I wouldn't be able to. So basically just change it from paper-1616.jar to paper-1616.jar -Djline.terminal=true?
Thanks for all the help, greatly appreciated.
The -D argument would need to go before -jar
Tried it with both true and false but it sadly doesn't help, console is still a mess. I'm trying to find out if I can connect to the server using something like PuTTY but it doesn't seem that VeryGames supports SSH.
This is my start.sh:
while true
do
java -Djline.terminal=true -jar paper-1616.jar
done
Here's a full log of my server starting: https://pastebin.com/d4RMKTBz
I also tried using -Djline.terminal=jline.UnsupportedTerminal instead after some Googling, sadly did not make a difference. I then tried skipping the bootloader I'm using and letting OpenMod boot Paper directly, sadly did also not make any difference.
The main problem seems to be the [K in front of every line, and when a line uses colored text, the color doesn't seem to end and colors every line below it, next to inserting other text like [0,33,1m[. A lot of lines look completely normal, with correct coloring (aside of the [K in front of the line) but others mess up everything below it, like lines by SkinsRestorer and Fast Async WorldEdit.
When using say in the console everything seems to mess up and I can barely even read the text:
https://i.imgur.com/EujkNSA.png
Try
-Djline.terminal=false
or
-Dterminal.ansi=false
I already tried the first line before, just tried the second one but sadly no dice :/ I'll send in a support ticket to the server provider too, maybe they know what's up or can at least tell me what OS, etc. it's using.
I got a reply from their support asking me to create a new installation in my server and installing Paper directly instead of through OpenMod. The console still displays all the weird garbled text, so this seems to be related to their web console. Hopefully they can find a fix. If it's something I can change on my side of things I'll share it here, in case someone runs into the same problem
Turns out they're kind of dicks. Their response after explaining everything: "The is a modpack related issue, we don't have that issue on another modpack". I've tried explaining again how Paper is supposed to replace Spigot, and that more people are probably going to want to use it. I've also (again) asked them to provide the server OS, version and console version.
Last response, they never told me what the server is using so unless there's a command I can run within the MC console I can't find out. They're saying it's an issue with Paper so they won't try to fix it, but they also won't give me the information I need to check with you guys if we can fix it.
Update
Using lagmonitor I was able to print out this, is this what is needed?
/env
[22:48:48 INFO]: OS Name: Linux
[22:48:48 INFO]: OS Arch: amd64
[22:48:48 INFO]: OS family: Debian GNU/Linux
[22:48:48 INFO]: OS version: 9 (stretch) build 4.9.0-8-amd64
[22:48:48 INFO]: OS Manufacturer: GNU/Linux
[22:48:48 INFO]: Total processes: 18
[22:48:48 INFO]: Total threads: 2176
[22:48:48 INFO]: CPU:
[22:48:48 INFO]: Vendor: GenuineIntel
[22:48:48 INFO]: Family: 6
[22:48:48 INFO]: Name: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
[22:48:48 INFO]: Model: 158
[22:48:48 INFO]: Id: Intel64 Family 6 Model 158 Stepping 9
[22:48:48 INFO]: Vendor freq: 4200000000
[22:48:48 INFO]: Physical Cores: 2
[22:48:48 INFO]: Logical Cores: 1
[22:48:48 INFO]: Endian: little
[22:48:48 INFO]: Load Average: 9.77
[22:48:48 INFO]: System Usage: 100 %
[22:48:48 INFO]: Process Usage: 0.0045 %
[22:48:48 INFO]: Total Swap: 1021.99 MiB
[22:48:48 INFO]: Free Swap: 1021.99 MiB
[22:48:48 INFO]: Total OS RAM: 62.58 GiB
[22:48:48 INFO]: Free OS RAM: 13.84 GiB
[22:48:48 INFO]: Disk Size: 18.55 GiB
[22:48:48 INFO]: Free Space: 11.02 GiB
[22:48:48 INFO]: Open file descriptors: 292
[22:48:48 INFO]: Max file descriptors: 65535
[22:48:48 INFO]: Variables:
[22:48:48 INFO]: PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
[22:48:48 INFO]: LANGUAGE: en_US.UTF-8
[22:48:48 INFO]: SHELL: /bin/bash
[22:48:48 INFO]: TZ: Europe/Amsterdam
[22:48:48 INFO]: TERM: screen
[22:48:48 INFO]: OLDPWD: /data
[22:48:48 INFO]: USER: games
[22:48:48 INFO]: LANG: en_US.UTF-8
[22:48:48 INFO]: SUDO_USER: root
[22:48:48 INFO]: SUDO_COMMAND: /data/service3194/start.sh
[22:48:48 INFO]: SUDO_GID: 0
[22:48:48 INFO]: MAIL: /var/mail/games
[22:48:48 INFO]: LC_ALL: en_US.UTF-8
[22:48:48 INFO]: LD_LIBRARY_PATH: /data/service3194/data/service_item_690324/:/data/service3194/data/service_item_690324//bin:/data/service3194/data/service_item_690324//linux64::/bin:
[22:48:48 INFO]: USERNAME: games
[22:48:48 INFO]: LOGNAME: games
[22:48:48 INFO]: SUDO_UID: 0
[22:48:48 INFO]: PWD: /data/service3194/data/service_item_690324
[22:48:48 INFO]: SHLVL: 1
[22:48:48 INFO]: HOME: /usr/games
[22:48:48 INFO]: _: /usr/bin/java
/native
[22:55:20 INFO]: OS Uptime: 0 days 16 hours 35 minutes 29 seconds
[22:55:20 INFO]: Looking for library 'udev'
[22:55:20 INFO]: Adding paths from jna.library.path: null
[22:55:20 INFO]: Trying libudev.so
[22:55:20 INFO]: Adding system paths: [/usr/lib/x86_64-linux-gnu, /lib/x86_64-linux-gnu, /lib64, /usr/lib, /lib, /lib/i386-linux-gnu, /lib32, /usr/lib/i386-linux-gnu, /usr/lib32]
[22:55:20 INFO]: Trying libudev.so
[22:55:20 INFO]: Looking for version variants
[22:55:20 INFO]: Trying /lib/x86_64-linux-gnu/libudev.so.1.6.5
[22:55:20 INFO]: Found library 'udev' at /lib/x86_64-linux-gnu/libudev.so.1.6.5
[22:55:20 INFO]: Disk read bytes: 3.27 TiB
[22:55:20 INFO]: Disk write bytes: 17.12 TiB
[22:55:20 INFO]: Disks:
[22:55:20 INFO]: /dev/nvme0n1: Unknown 419.19 GiB
[22:55:20 INFO]: /dev/nvme1n1: Unknown 419.19 GiB
[22:55:20 INFO]: /dev/md2: Unknown 510.94 MiB
[22:55:20 INFO]: /dev/md3: Unknown 19.53 GiB
[22:55:20 INFO]: /dev/md4: Unknown 796.30 GiB
[22:55:20 INFO]: Mounts:
[22:55:20 INFO]: /: Mount Point zfs 612.13 MiB/10.10 GiB
[22:55:20 INFO]: /dev/lxd: Ram Disk tmpfs 0 B/100.00 kiB
[22:55:20 INFO]: /data: Mount Point zfs 7.54 GiB/18.55 GiB
[22:55:20 INFO]: /dev/.lxd-mounts: Ram Disk tmpfs 0 B/100.00 kiB
[22:55:20 INFO]: CPU Temp °C: 73.0
[22:55:20 INFO]: Voltage: 0.0
[22:55:20 INFO]: Fan speed (rpm): []
[22:55:20 INFO]: System Manufacturer: Intel Corporation
[22:55:20 INFO]: System model: S1200SP (version: ....................)
[22:55:20 INFO]: Serial number: unknown
[22:55:20 INFO]: Baseboard:
[22:55:20 INFO]: Manufacturer: Intel Corporation
[22:55:20 INFO]: Model: S1200SP
[22:55:20 INFO]: Serial: H57532-260
[22:55:20 INFO]: Version: H57532-260
[22:55:20 INFO]: BIOS Firmware:
[22:55:20 INFO]: Manufacturer: Intel Corporation
[22:55:20 INFO]: Name: unknown
[22:55:20 INFO]: Description: dmi:bvnIntelCorporation:bvrS1200SP.86B.03.01.1029.012520180838:bd01/25/2018:svnIntelCorporation:pnS1200SP:pvr....................:rvnIntelCorporation:rnS1200SP:rvrH57532-260:cvn...............................:ct23:cvr..................:
[22:55:20 INFO]: Version: S1200SP.86B.03.01.1029.012520180838
[22:55:20 INFO]: Release date: 1/25/18
/vm
[22:56:29 INFO]: Java version: 1.8.0_212 (Outdated)
[22:56:29 INFO]: Java release date: n/a
[22:56:29 INFO]: Class version: 52.0
[22:56:29 INFO]: Java lib: /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64
[22:56:29 INFO]: Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
[22:56:29 INFO]: Temp path: /tmp
[22:56:29 INFO]: Java VM: OpenJDK 64-Bit Server VM 25.212-b01
[22:56:29 INFO]: Java vendor: Oracle Corporation
[22:56:29 INFO]: Spec name: Java Virtual Machine Specification
[22:56:29 INFO]: Spec vendor: Oracle Corporation
[22:56:29 INFO]: Spec version: 1.8
[22:56:29 INFO]: Compiler name: HotSpot 64-Bit Tiered Compilers
[22:56:29 INFO]: Compilation time (ms): 164162
[22:56:29 INFO]: Loaded classes: 16881
[22:56:29 INFO]: Total loaded: 16881
[22:56:29 INFO]: Unloaded classes: 0
[22:56:29 INFO]: Garbage collector: Copy
[22:56:29 INFO]: Count: 2699
[22:56:29 INFO]: Time (ms): 24852
[22:56:29 INFO]: Garbage collector: MarkSweepCompact
[22:56:29 INFO]: Count: 9
[22:56:29 INFO]: Time (ms): 3733
Hello, I've the same issue about the console and I host my server on VeryGames too.
I've contacted their support to see if it was a VM related issue and they told me the exact same thing, the first time that I need to use openmod instead of direct install of paper trought the verygames panel (I did it, nothing change at all) and the second time they told me that it was a paper related issue and they can't do anything about that, only paper's developpers can.
The server had no lags, no CPU/RAM overloaded and no errors causing by the plugins, just this weird [?1h=› or [?2004h› that make my console/logs unreadable. (but in my case [K is the name of my panel)
I didnt understand what's @electronicboy had suggested about -Djline.terminal=true but if someone can explain me I would like to try it to see if the issue can be fixed.
I've installed Paper on 1.14.4 (build 243) and the following plugins :
And there is a example of the issue (lines 11 & 467 -> 472) :
I really want to know where it comes from and help to fix it, if you need more infos let me know.
Were you able to fix it? Also have a server hosted on verygames and when i've changed to OpenMod for PaperMC build 24 i had those weird [?1h stuff spamming wich lead to server lag and being unable to join the server for 10-20sec
Edit: I've tested the same server on localhost and the issue didnt occur once btw
Were you able to fix it? Also have a server hosted on verygames and when i've changed to OpenMod for PaperMC build 24 i had those weird [?1h stuff spamming wich lead to server lag and being unable to join the server for 10-20sec
Edit: I've tested the same server on localhost and the issue didnt occur once btw
Sadly there's no fix, this issue is with VeryGames themselves. Their console doesn't work with the color codes so it shows them all messed up. I contacted their support and tried to get them to change their console so it would support it, but they said they were not going to change it.
I've since changed to a self hosted server in my own home so no more messed up console. Only fix is changing server providers sadly :/
Tried it with both true and false but it sadly doesn't help, console is still a mess. I'm trying to find out if I can connect to the server using something like PuTTY but it doesn't seem that VeryGames supports SSH.
This is my start.sh:
while true do java -Djline.terminal=true -jar paper-1616.jar doneHere's a full log of my server starting: https://pastebin.com/d4RMKTBz
Edit
I also tried using
-Djline.terminal=jline.UnsupportedTerminalinstead after some Googling, sadly did not make a difference. I then tried skipping the bootloader I'm using and letting OpenMod boot Paper directly, sadly did also not make any difference.The main problem seems to be the
[Kin front of every line, and when a line uses colored text, the color doesn't seem to end and colors every line below it, next to inserting other text like[0,33,1m[. A lot of lines look completely normal, with correct coloring (aside of the[Kin front of the line) but others mess up everything below it, like lines by SkinsRestorer and Fast Async WorldEdit.When using
sayin the console everything seems to mess up and I can barely even read the text:
https://i.imgur.com/EujkNSA.png
(Dont know how to private message in github)
How did you change your start.sh, im using OpenMod too, i use FTP to acess the server files but theres no Start.sh, do i have to create it?
I know this is closed but wanted to add that the fix for my host was to change start.sh and add --nojline to the end.
e.g.
-jar server.jar --nojline
I have solved my problem by using Hyper Terminal
I have solved my problem by using Hyper Terminal
Any terminal would fix this, but VeryGames doesn’t offer SSH support.
Most helpful comment
/timings on, wait 15 minutes or so while you experience lag, /timings paste -> give us the link. nothing we can do without that as there is no wait to actually look into your claims.
your console issue is a different issue, but since you have not provided any info about your system (os, os version, locale, terminal etc) we also can't help you there. for console issues it will most likely say something on the very top of your log.