-
@ Coinos
2025-05-11 19:09:08
SERVICE UPDATE (Copied from Telegram)
At the moment I'm still trying to scan through a 2 TB disk image I took of the Coinos server to see if I can find remnants of any more recent but deleted backups that were created closer to the time that our database failure occurred.
If I can locate some then I need to piece them together because they may just be partial fragments on the disk and parts of them may have been overwritten. If I can recover some data from them then I'll start using that to get people's balances.
Failing that I will have to see if I can start cross referencing my web server logs. My application server logs would have been a lot more helpful but they were rotated away too unfortunately because they grew too large as the application was spamming a ton of error messages for a few hours while the DB was down.
This morning I hatched a bit of a plan to try and enable partial withdrawals while I continue working on this data recovery. I'd like to allow people to withdraw any funds that they deposited after the incident occurred because I know those are legit. I just need to code that up so that I can maintain a separate balance for pre-incident and post-incident funds.
I can't enable full withdrawals until I do a full accounting of all the activity that occurred in between my last backup and the db failure. Some people will be missing funds that they deposited but others will have extra funds that they withdrew already but are now showing back up in their balance because everyone's balances were rolled back by a day or two.
I still don't have any solid ETA but probably at least another day or two before full withdrawals are back. Hopefully by tonight I'll have partial withdrawals for any funds that were deposited after about 10am PT yesterday.