Recent changes
From Inside
Track the most recent changes to the wiki on this page.
List of abbreviations:
- N
- This edit created a new page (also see list of new pages)
- m
- This is a minor edit
- b
- This edit was performed by a bot
- (±123)
- The page size changed by this number of bytes
22 June 2024
00:00 | ITTR:Moodle/VPLJail diffhist +158 Ssulaimi talk contribs DP#3065508 — Install dev libraries onto VPL |
21 June 2024
|
20:18 | ITP:Act/20160512.20:55/2024 lfs-isr1 XenClient XenBatch Zab00 2 changes history +1,446 [Rfulcher (2×)] | |||
|
20:18 (cur | prev) +543 Rfulcher talk contribs * Per masterfiles/xenserver/bin/XenSnapBackupsAuto.sh DPTrac:projects/sysconfig/changeset/20814 Start the wb00001 USXCPNG82 job 21 hours earlier than before. | ||||
|
19:43 (cur | prev) +903 Rfulcher talk contribs === 20240614 XenBatch Zab00 Cron === .... .... Record each pools email report subject. |
20:08 | ITP:Act/20151208.23:57/20220110-lfs-us-moodle-LoopBacks diffhist +7,134 Rfulcher talk contribs →202406 Daily RSync 2015-2024 and DigiPen Moodle: Moodle2024 1.8T 176G 91% but then zfs crashed to restarted Fri Jun 21 19:52:31 # MoodleSG2024 778G 180G 82% # : '''Might want to expand these xvdb mysql partitions on all the members soon''' |
|
19:41 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements 2 changes history +1,204 [Rfulcher (2×)] | |||
|
19:41 (cur | prev) -38,728 Rfulcher talk contribs prune rebalance progress to hourly. | ||||
|
16:27 (cur | prev) +39,932 Rfulcher talk contribs verbose progress. |
19:38 | ITP:Act/20161026.02:11/20220718-imap01 imap01Archive03 diffhist +1,092 Rfulcher talk contribs : 06/21/24, 11:49 - [it-alerts] saturn SyncImapToLizardFS.sh 38%/ 47%local 23%archive 45%alumni 50%student 67%faculty 29%wanic 76%staff # 247G 95% /zfs/imap01Archive04 |
N 17:04 | ITTR:Contacts/Shoc Networks diffhist +241 Rfulcher talk contribs New contact |
20 June 2024
|
23:01 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements 2 changes history +12,224 [Rfulcher (2×)] | |||
|
23:01 (cur | prev) +5,817 Rfulcher talk contribs Put ~64T erinome:mfsbrick0500 back into service | ||||
|
21:04 (cur | prev) +6,407 Rfulcher talk contribs * Recently fixed the Jupiter bond to no longer include the third slow 1GB NIC, per #Jupiter fix MLAG Bond to not include 1GB member so would like to reboot jupiter to put that change into service before resuming Erinome also... |
17 June 2024
18:23 | ITTR:Backup/Bacula/Audits diffhist +100 Rfulcher talk contribs Incr07CW - ITTR:Backup/Bacula/Audits/US/2024-06-14-Incr - 0022.3914 (81554 Sec) - 1262093007638 (1.26 TB) - 0020.4833 (74913 Sec) - DP0172+DP0171 |
N 18:22 | ITTR:Backup/Bacula/Audits/US/2024-06-14-Incr diffhist +85,479 Rfulcher talk contribs Incr07CW - 0022.3914 (81554 Sec) - 1262093007638 (1.26 TB) - 0020.4833 (74913 Sec) - DP0172+DP0171 |
18:10 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements diffhist +6,479 Rfulcher talk contribs Treat the erinome 9750-16i4e as if it were a LIBERATOR to properly output the disk members # mfsbrick0500 can now go back into service soon. |
|
18:08 | ITTR Talk:Storage/Bricks 2 changes history +659 [Rfulcher (2×)] | |||
|
18:08 (cur | prev) +203 Rfulcher talk contribs * 2024-06-17T18:00:04 ::: erinome:mfsbrick0500:/dev/sdc:9750-16i4e DISK 7JH0V1GG63D2A500878B LSI: Drive: RW : fixed to include members :: mfsbrick0500 is LSI:/c0/u0/p( 0 1 2 3 4 5 6 7 ) RAID-5 OK 65192.5 | ||||
|
18:06 (cur | prev) +456 Rfulcher talk contribs * 2024-06-17T15:00:04 ::: europa:megas,2 pass2 ST10000VN0004-1ZD101 ZA26JQ8N SATA ReAlSec:7712 errors continue to increase. |
17:53 | ITP:Act/20161026.02:11/20220718-imap01 imap01Archive03 diffhist +1,035 Rfulcher talk contribs : 06/17/24, 09:43 - [it-alerts] saturn SyncImapToLizardFS.sh 37%/ 46%local 23%archive 45%alumni 50%student 67%faculty 29%wanic 76%staff # 247G 95% /zfs/imap01Archive04 |
14 June 2024
|
21:02 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements 3 changes history +13,969 [Rfulcher (3×)] | |||
|
21:02 (cur | prev) +1,622 Rfulcher talk contribs Tried to resume services, but something is wrong with network routing... will take a closer look later. | ||||
|
20:47 (cur | prev) +11,295 Rfulcher talk contribs erinome bond0 is up and working. | ||||
|
19:40 (cur | prev) +1,052 Rfulcher talk contribs Erinome array finished initializing :: Fri 14 Jun 2024 11:09:57 AM PDT u0 RAID-5 OK - - 256K 65192.5 RiW OFF |
19:32 | ITTR Talk:Storage/Bricks diffhist +321 Rfulcher talk contribs * 2024-06-14T16:00:04 :: europa:mfsbrick0400 is Megaraid:mfid0 E1:S( 0 1 2 3 4 5 6 7 ) (64T) RAID-5 64K OPTIMAL spans: is done. |
|
N 19:21 | ITP:Act/20160727.03:27/20240614-ES XCPNG Ganymede 2 changes history +15,241 [Rfulcher (2×)] | |||
|
19:21 (cur | prev) +3,186 Rfulcher talk contribs Run XenSnapBackupsAuto.sh once right now since we missed runninging it earlier due to upgrades | ||||
N |
|
18:43 (cur | prev) +12,055 Rfulcher talk contribs Spain Hardware Resources improvements: ChatLog: |
18:46 | ITP:Act/20240613.21:58 diffhist +1,407 Rfulcher talk contribs Cleanup the disk image: |
13 June 2024
20:54 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements diffhist +9,773 Rfulcher talk contribs New ===== Amalthea hugo reformat as 512e three more Erinome Disks ===== and ===== Replace bad disk in new Erinome mfsbrick0500 ===== |
|
N 18:26 | ITP:Act/20240613.21:58 2 changes history +8,151 [Rfulcher (2×)] | |||
|
18:26 (cur | prev) +3,990 Rfulcher talk contribs Managed to get a clone of metis running that has the exact same problem. | ||||
N |
|
15:50 (cur | prev) +4,161 Rfulcher talk contribs Metis Server Tower Chassis not booting. |
12 June 2024
18:16 | ITTR Talk:Storage/Bricks diffhist +1,223 Rfulcher talk contribs europa:mfsbrick0400 Megaraid:mfid0 running multi day Patrol Read pass, is about 70% finished now. |
17:51 | ITP:Act/20161026.02:11/20220718-imap01 imap01Archive03 diffhist +414 Rfulcher talk contribs : 06/12/24, 10:43 - [it-alerts] saturn SyncImapToLizardFS.sh 37%/ 46%local 23%archive 45%alumni 50%student 67%faculty 29%wanic 76%staff # 243G 95% /zfs/imap01Archive04 |
17:48 | ITTR:US Servers/Faculty/UniTime2 diffhist +5,699 Rfulcher talk contribs Switch mysql default_time_zone from -07:00 to America/Los_Angeles |
11 June 2024
14:23 | ITP:Act/20151208.23:57/20220110-lfs-us-moodle-LoopBacks diffhist +1,299 Rfulcher talk contribs →202406 Daily RSync 2015-2024 and DigiPen Moodle: MoodleSG2024 754G 202G 79% # Moodle2024 1.7T 225G 89% |
14:01 | ITP:Act/20160512.20:55/2024 lfs-isr1 XenClient XenBatch Zab00 diffhist +3,042 Rfulcher talk contribs === 20240607 XenBatch Zab02 Cron === .... .... Record each pools email report subject. |
10 June 2024
|
20:31 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements 3 changes history +8,421 [Rfulcher (3×)] | |||
|
20:31 (cur | prev) +918 Rfulcher talk contribs zpool create mfsbrick0500 # done but going to wait for new disk before going back into service. | ||||
|
20:22 (cur | prev) +740 Rfulcher talk contribs Second attempt to rebuild with disk p5 and ignoreECC also failed | ||||
|
18:18 (cur | prev) +6,763 Rfulcher talk contribs erinome /c0/u0 disk p5 throwing ECC-ERROR during init. Try using ignoreECC while we wait on some new spare 10TiB Disks per PO:111-5891048-3007451 |
|
19:15 | ITTR:US Servers/Faculty/UniTime2 2 changes history +14,478 [Rfulcher (2×)] | |||
|
19:15 (cur | prev) +2,033 Rfulcher talk contribs Executed === 20240610 Upgrade to java version 17 at production unitime2 === | ||||
|
19:02 (cur | prev) +12,445 Rfulcher talk contribs 20240610 unitime2 apply mysql default_time_zone solution |
17:47 | ITP:Act/20161026.02:11/20220718-imap01 imap01Archive03 diffhist +871 Rfulcher talk contribs : 06/10/24, 10:41 - [it-alerts] saturn SyncImapToLizardFS.sh 36%/ 46%local 23%archive 45%alumni 50%student 67%faculty 29%wanic 76%staff # CompressImapBackups.sh 4.1T 246G 95% /zfs/imap01Archive04 |
17:10 | ITTR:Backup/Bacula/Audits diffhist +102 Rfulcher talk contribs Incr07CV - ITTR:Backup/Bacula/Audits/US/2024-06-07-Incr - 0111.1146 (126706 Sec) - 2957437128963 (2.96 TB) - 0110.3308 (124388 Sec) - DP0173+DP0172 |
N 17:09 | ITTR:Backup/Bacula/Audits/US/2024-06-07-Incr diffhist +85,539 Rfulcher talk contribs Incr07CV - 0111.1146 (126706 Sec) - 2957437128963 (2.96 TB) - 0110.3308 (124388 Sec) - DP0173+DP0172 |
7 June 2024
|
21:08 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements 3 changes history +4,820 [Rfulcher (3×)] | |||
|
21:08 (cur | prev) +614 Rfulcher talk contribs Getting 5min noise from temp task so disable for now: | ||||
|
20:59 (cur | prev) +2,110 Rfulcher talk contribs tw_cli /c0 add type=raid5 disk=0:1:2:3:4:5:6:7 storsave=perform # used to init the array, but now the controller is replying very slowly. | ||||
|
20:31 (cur | prev) +2,096 Rfulcher talk contribs 20240607 * Swapped out the 9650SE for 9750 even though the SAS cables were pretty tight, made it work. |
19:15 | ITTR:Moodle diffhist +324 Rfulcher talk contribs New ==== Enable the TeX notation Filter if v4 ==== |
18:46 | ITP:Act/20161026.02:11/20220718-imap01 imap01Archive03 diffhist +621 Rfulcher talk contribs : 06/07/24, 11:59 - [it-alerts] saturn SyncImapToLizardFS.sh 37%/ 46%local 22%archive 45%alumni 50%student 67%faculty 29%wanic 76%staff # 254G 95% /zfs/imap01Archive04 |
18:42 | ITP:Act/20151208.23:57/20220110-lfs-us-moodle-LoopBacks diffhist +1,027 Rfulcher talk contribs →202406 Daily RSync 2015-2024 and DigiPen Moodle: MoodleSG2024 711G 146G 83% # Grow MoodleSG2024 +100G # Moodle2024 1.7T 231G 89% |
6 June 2024
|
21:27 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements 3 changes history +6,811 [Rfulcher (3×)] | |||
|
21:27 (cur | prev) +1,821 Rfulcher talk contribs : Ryan Fulcher - 9:13 PM - So Erinome has a 9650SE-8LPML controller and it doesn't seem the new 10T (512e) SAS disks. Running FW:FE9X 4.10.00.027, John Watkins do you think you can try to upgrade it so it might see the new disks? :: If not, it's fine, I can swap in a 9750-16i4e which I have right here that should work for those disks. | ||||
|
19:55 (cur | prev) +2,788 Rfulcher talk contribs The etc/network/interfaces got reverted to cfengine default due to lose of immutable when transfering system to new md0 disk mirror. # check for other previously immutable, rest are probably fine. | ||||
|
19:04 (cur | prev) +2,202 Rfulcher talk contribs tw_cli /c0/u0 del # RAID-6 22351.7 erinome:mfsbrick05.00 # reboot to Confirm can still boot with old system and brick 3ware now destroyed. |
5 June 2024
21:57 | ITTR:Backup/Bacula/Audits diffhist +6,561 Rfulcher talk contribs ** Per #Add Colleague Jobs setup new jobs |
19:15 | ITP:Act/20151208.23:57/20240212-More Raid Storage Refinements diffhist +3,196 Rfulcher talk contribs The ==== Erinome System RAID Upgrade ==== is not finished. |