About
Andrew Stacey
Information about my research, teaching, and other interests.
By: Andrew Stacey
Contact details
| home :: HowDidIDoThat :: Mathematical :: nlab_stats |
Feeds: Atom  RSS2.0
|
Fri, 21st Aug 2009 (HowDidIDoThat :: Mathematical)
nLab Statistics
Here are some statistics gleaned from the logs of three Instiki processes. Two are versions of the nlab: the original host and the migration. The third is a much smaller installation, included just for some comparison. The significant details are:
| Nickname | Database | Size | Connection |
|---|---|---|---|
| nLab | sqlite3 | 110Mb | Mongrel proxied through lighttpd |
| migrated nLab | MySQL | 110Mb | Apache with Phusion Passenger |
| Mini | sqlite3 | 1Mb | Webbrick |
Here are the tables from the logs. All times are in milliseconds. The mode columns are calculated by first rounding up to the nearest multiple of the number in parentheses. Thus a mode of 10 in the second column means that when viewed in blocks of 10ms, the largest number were completed in less than 10ms. The percentages in these columns give the relative size of the mode.
nLab
| Type | Cached | Requests | Mean | Median | Mode (1) | Mode (10) | Mode (100) | Mode (1000) |
|---|---|---|---|---|---|---|---|---|
| atom_with_content | Yes | 81 | 14,596.37 | 127 | 6, 7, (16%) | 10, (37%) | 100, (45%) | 1,000, (54%) |
| atom_with_headlines | Yes | 165 | 7,628.98 | 6 | 6, (38%) | 10, (55%) | 100, (66%) | 1,000, (68%) |
| authors | No | 1 | 5 | 5 | 6, (100%) | 10, (100%) | 100, (100%) | 1,000, (100%) |
| authors | Yes | 30 | 11,425.67 | 9,800.5 | 8, (16%) | 10, (26%) | 100, (43%) | 1,000, (46%) |
| cancel_edit | No | 13 | 132.85 | 103 | 27, 46, 74, 78, 80, 83, 104, 118, 125, 178, 209, 246, 372, (7%) | 80, (23%) | 100, (46%) | 1,000, (100%) |
| edit | No | 378 | 236.83 | 214.5 | 6, (8%) | 10, (14%) | 300, (27%) | 1,000, (99%) |
| export | No | 14 | 86.64 | 76 | 6, 57, 58, 62, 65, 68, 76, 78, 83, 98, 134, 138, 150, 154, (7%) | 70, (21%) | 100, (71%) | 1,000, (100%) |
| export_markup | No | 5 | 6,913.6 | 70 | 6, (40%) | 10, (40%) | 100, (60%) | 1,000, (80%) |
| feeds | No | 18 | 98.78 | 70 | 145, (11%) | 60, 70, (22%) | 100, (55%) | 1,000, (100%) |
| history | Yes | 26 | 189.27 | 160 | 6, 41, 111, 273, (7%) | 150, 280, (11%) | 100, (30%) | 1,000, (100%) |
| index | No | 137 | 10.73 | 5 | 6, (65%) | 10, (94%) | 100, (97%) | 1,000, (100%) |
| list | Yes | 65 | 23,812.38 | 399 | 7, 8, (9%) | 10, (30%) | 100, (41%) | 1,000, (52%) |
| locked | No | 8 | 86.38 | 83 | 6, (25%) | 10, (25%) | 100, (62%) | 1,000, (100%) |
| login | No | 5 | 75 | 60 | 6, 45, 61, 74, 194, (20%) | 10, 50, 70, 80, 200, (20%) | 100, (80%) | 1,000, (100%) |
| new | No | 257 | 105.65 | 71 | 6, (8%) | 70, (21%) | 100, (59%) | 1,000, (100%) |
| Yes | 44 | 225.45 | 123.5 | 7, (9%) | 10, (13%) | 100, (40%) | 1,000, (95%) | |
| published | Yes | 21 | 59.76 | 31 | 6, 10, (14%) | 10, (38%) | 100, (71%) | 1,000, (100%) |
| recently_revised | Yes | 13 | 83.31 | 47 | 30, (15%) | 30, (30%) | 100, (76%) | 1,000, (100%) |
| revision | Yes | 144 | 1,869.07 | 512 | 6, (7%) | 10, (10%) | 100, (26%) | 1,000, (65%) |
| rollback | No | 12 | 215.75 | 204.5 | 6, (25%) | 10, (25%) | 300, (33%) | 1,000, (100%) |
| save | No | 317 | 3,275.31 | 2,351 | 2, (4%) | 10, (8%) | 100, (9%) | 2,000, (26%) |
| search | No | 25 | 38,951.32 | 37,302 | 6, 3205, 3280, 3321, 11143, 27917, 29498, 30562, 32806, 33487, 35045, 36931, 37303, 41620, 42212, 43264, 47044, 47591, 48431, 49106, 52529, 68064, 76626, 86279, 86538, (4%) | 10, 3210, 3280, 3330, 11150, 27920, 29500, 30570, 32810, 33490, 35050, 36940, 37310, 41620, 42220, 43270, 47050, 47600, 48440, 49110, 52530, 68070, 76630, 86280, 86540, (4%) | 3,300, (8%) | 4,000, (12%) |
| show | No | 5 | 1,666.2 | 5 | 6, (60%) | 10, (60%) | 100, (60%) | 1,000, (60%) |
| show | Yes | 5219 | 388.92 | 50 | 6, (6%) | 30, (12%) | 100, (66%) | 1,000, (89%) |
| tex | Yes | 13 | 90.31 | 61 | 6, 21, 22, 23, 52, 60, 62, 73, 91, 94, 114, 161, 408, (7%) | 30, (23%) | 100, (76%) | 1,000, (100%) |
| web_list | No | 133 | 31,338.11 | 31,609 | 6, (8%) | 10, (11%) | 100, (23%) | 1,000, (24%) |
Note: recently_revised for the nlab itself is redirected by the web server to an internal page. The row in the table above is thus for all the other webs and so should not be compared with the row in the migrated nlab table as that is not redirected and so does include recently_revised for the nlab.
migrated nLab
| Type | Cached | Requests | Mean | Median | Mode (1) | Mode (10) | Mode (100) | Mode (1000) |
|---|---|---|---|---|---|---|---|---|
| atom_with_content | Yes | 12 | 4,140.42 | 3.5 | 4, (50%) | 10, (58%) | 100, (66%) | 1,000, (83%) |
| atom_with_headlines | Yes | 12 | 541.58 | 40.5 | 4, (33%) | 10, (33%) | 100, (66%) | 1,000, (66%) |
| authors | Yes | 8 | 2,261.75 | 199 | 5, 67, 106, 138, 262, 305, 8352, 8867, (12%) | 10, 70, 110, 140, 270, 310, 8360, 8870, (12%) | 100, 200, (25%) | 1,000, (75%) |
| cancel_edit | No | 9 | 19.89 | 5 | 6, (55%) | 10, (88%) | 100, (88%) | 1,000, (100%) |
| edit | No | 63 | 368.79 | 117 | 57, (4%) | 60, (14%) | 100, (38%) | 1,000, (92%) |
| export | No | 6 | 68 | 54.5 | 36, 49, 51, 60, 98, 120, (16%) | 60, (33%) | 100, (83%) | 1,000, (100%) |
| feeds | No | 8 | 134.25 | 110 | 51, 57, 107, 110, 112, 137, 202, 306, (12%) | 60, 110, (25%) | 200, (50%) | 1,000, (100%) |
| history | Yes | 2 | 191 | 191 | 137, 247, (50%) | 140, 250, (50%) | 200, 300, (50%) | 1,000, (100%) |
| index | No | 46 | 76.74 | 23.5 | 4, (19%) | 10, (34%) | 100, (80%) | 1,000, (97%) |
| list | Yes | 24 | 4,270.29 | 497 | 2,961, (8%) | 140, 2970, (8%) | 200, (16%) | 1,000, (70%) |
| locked | No | 10 | 84.4 | 69.5 | 47, 50, 56, 58, 65, 76, 119, 121, 127, 135, (10%) | 50, 60, 130, (20%) | 100, (60%) | 1,000, (100%) |
| login | No | 4 | 146.75 | 101.5 | 54, 56, 149, 332, (25%) | 60, (50%) | 100, (50%) | 1,000, (100%) |
| new | No | 336 | 1,989.63 | 80 | 47, (3%) | 50, (19%) | 100, (52%) | 1,000, (97%) |
| recently_revised | Yes | 32 | 3,515.59 | 114 | 8, (18%) | 10, (31%) | 100, (40%) | 1,000, (65%) |
| revision | Yes | 19 | 2,066.11 | 1,088 | 4, (10%) | 10, (10%) | 100, 500, 1100, (10%) | 1,000, (42%) |
| save | No | 23 | 2,118.22 | 1,570 | 3, (8%) | 10, (8%) | 100, 900, (13%) | 1,000, (43%) |
| search | No | 4 | 2,063.25 | 2,214 | 1376, 2000, 2430, 2451, (25%) | 1380, 2000, 2430, 2460, (25%) | 2,500, (50%) | 2000, 3000, (50%) |
| show | No | 2 | 2 | 2 | 3, (100%) | 10, (100%) | 100, (100%) | 1,000, (100%) |
| show | Yes | 1954 | 1,129.49 | 368.5 | 6, (6%) | 10, (12%) | 100, (23%) | 1,000, (79%) |
| web_list | No | 35 | 570.14 | 566 | 540, 636, (5%) | 540, (11%) | 600, (40%) | 1,000, (97%) |
migrated nLab after xsendfile enabled (duh!)
| Type | Cached | Requests | Mean | Median | Mode (1) | Mode (10) | Mode (100) | Mode (1000) |
|---|---|---|---|---|---|---|---|---|
| atom_with_headlines | Yes | 3 | 31.67 | 46 | 3, 47, 48, (33%) | 50, (66%) | 100, (100%) | 1,000, (100%) |
| authors | Yes | 3 | 2,133.33 | 63 | 4, 64, 6335, (33%) | 10, 70, 6340, (33%) | 100, (66%) | 1,000, (66%) |
| edit | No | 3 | 89.33 | 79 | 57, 80, 134, (33%) | 60, 80, 140, (33%) | 100, (66%) | 1,000, (100%) |
| export | No | 2 | 115.5 | 115.5 | 105, 128, (50%) | 110, 130, (50%) | 200, (100%) | 1,000, (100%) |
| feeds | No | 2 | 43 | 43 | 44, (100%) | 50, (100%) | 100, (100%) | 1,000, (100%) |
| index | No | 2 | 2 | 2 | 3, (100%) | 10, (100%) | 100, (100%) | 1,000, (100%) |
| list | Yes | 17 | 2,030.47 | 42 | 4, (47%) | 10, (47%) | 100, (58%) | 1,000, (76%) |
| new | No | 410 | 114.21 | 52 | 45, (4%) | 50, (33%) | 100, (69%) | 1,000, (98%) |
| recently_revised | Yes | 19 | 677.11 | 145 | 3, 4, (10%) | 10, (21%) | 100, (47%) | 1,000, (94%) |
| save | No | 2 | 4,217.5 | 4,217.5 | 4009, 4428, (50%) | 4010, 4430, (50%) | 4100, 4500, (50%) | 5,000, (100%) |
| search | No | 4 | 1,299.75 | 1,213 | 45, 1025, 1403, 2730, (25%) | 50, 1030, 1410, 2730, (25%) | 100, 1100, 1500, 2800, (25%) | 2,000, (50%) |
| search | Yes | 1 | 4,640 | 4,640 | 4,641, (100%) | 4,650, (100%) | 4,700, (100%) | 5,000, (100%) |
| show | No | 1 | 4,077 | 4,077 | 4,078, (100%) | 4,080, (100%) | 4,100, (100%) | 5,000, (100%) |
| show | Yes | 2087 | 150.67 | 10 | 4, (20%) | 10, (47%) | 100, (88%) | 1,000, (96%) |
| web_list | No | 2 | 289 | 289 | 118, 462, (50%) | 120, 470, (50%) | 200, 500, (50%) | 1,000, (100%) |
Mini Installation
| Type | Cached | Requests | Mean | Median | Mode (1) | Mode (10) | Mode (100) | Mode (1000) |
|---|---|---|---|---|---|---|---|---|
| atom_with_content | Yes | 31 | 323.16 | 8 | 7, (25%) | 10, (64%) | 100, (70%) | 1,000, (87%) |
| atom_with_headlines | Yes | 40 | 55.43 | 15 | 12, (12%) | 20, (45%) | 100, (85%) | 1,000, (100%) |
| authors | Yes | 24 | 78.21 | 51 | 8, (12%) | 10, (29%) | 100, (58%) | 1,000, (100%) |
| cancel_edit | No | 8 | 25.5 | 20 | 20, 27, (25%) | 20, (50%) | 100, (100%) | 1,000, (100%) |
| edit | No | 96 | 206.82 | 134 | 12, 13, (4%) | 20, (17%) | 100, (41%) | 1,000, (96%) |
| export | No | 10 | 80.8 | 89 | 38, 39, 53, 65, 89, 91, 100, 111, 113, 119, (10%) | 120, (30%) | 100, (70%) | 1,000, (100%) |
| feeds | No | 17 | 55.18 | 37 | 38, (23%) | 40, (70%) | 100, (82%) | 1,000, (100%) |
| history | Yes | 2 | 217 | 217 | 88, 348, (50%) | 90, 350, (50%) | 100, 400, (50%) | 1,000, (100%) |
| index | No | 102 | 49.56 | 27 | 7, (6%) | 10, (22%) | 100, (88%) | 1,000, (100%) |
| list | Yes | 63 | 71.13 | 16 | 7, 9, (12%) | 10, (41%) | 100, (68%) | 1,000, (100%) |
| locked | No | 24 | 100.92 | 109.5 | 121, (8%) | 60, (16%) | 200, (54%) | 1,000, (100%) |
| new | No | 46 | 389.02 | 127.5 | 42, 43, 46, 56, (4%) | 50, (19%) | 100, (41%) | 1,000, (89%) |
| Yes | 2 | 363.5 | 363.5 | 94, 635, (50%) | 100, 640, (50%) | 100, 700, (50%) | 1,000, (100%) | |
| recently_revised | Yes | 49 | 56.16 | 10 | 8, 9, (14%) | 10, (42%) | 100, (79%) | 1,000, (100%) |
| revision | Yes | 6 | 153.33 | 150.5 | 16, 121, 150, 153, 176, 310, (16%) | 20, 130, 150, 160, 180, 310, (16%) | 200, (66%) | 1,000, (100%) |
| save | No | 51 | 653.1 | 299 | 344, 515, (3%) | 140, (7%) | 200, (25%) | 1,000, (86%) |
| show | No | 1 | 228 | 228 | 229, (100%) | 230, (100%) | 300, (100%) | 1,000, (100%) |
| show | Yes | 576 | 110.68 | 24 | 15, (7%) | 20, (41%) | 100, (79%) | 1,000, (97%) |
| tex | Yes | 4 | 86.25 | 66.5 | 34, 52, 83, 180, (25%) | 40, 60, 90, 180, (25%) | 100, (75%) | 1,000, (100%) |
[Full link]
Last modified on:
Tue, 25th Aug 2009