Andrew Stacey


About
Andrew Stacey
Information about my research, teaching, and other interests.

By: Andrew Stacey
Contact details


Andrew Stacey


blosxom icon


Fri, 21st Aug 2009 (HowDidIDoThat :: Mathematical)

nLab Statistics

Here are some statistics gleaned from the logs of three Instiki processes. Two are versions of the nlab: the original host and the migration. The third is a much smaller installation, included just for some comparison. The significant details are:

Nickname Database Size Connection
nLab sqlite3 110Mb Mongrel proxied through lighttpd
migrated nLab MySQL 110Mb Apache with Phusion Passenger
Mini sqlite3 1Mb Webbrick

Here are the tables from the logs. All times are in milliseconds. The mode columns are calculated by first rounding up to the nearest multiple of the number in parentheses. Thus a mode of 10 in the second column means that when viewed in blocks of 10ms, the largest number were completed in less than 10ms. The percentages in these columns give the relative size of the mode.

nLab

TypeCachedRequestsMeanMedianMode (1)Mode (10)Mode (100)Mode (1000)
atom_with_contentYes8114,596.371276, 7, (16%)10, (37%)100, (45%)1,000, (54%)
atom_with_headlinesYes1657,628.9866, (38%)10, (55%)100, (66%)1,000, (68%)
authorsNo1556, (100%)10, (100%)100, (100%)1,000, (100%)
authorsYes3011,425.679,800.58, (16%)10, (26%)100, (43%)1,000, (46%)
cancel_editNo13132.8510327, 46, 74, 78, 80, 83, 104, 118, 125, 178, 209, 246, 372, (7%)80, (23%)100, (46%)1,000, (100%)
editNo378236.83214.56, (8%)10, (14%)300, (27%)1,000, (99%)
exportNo1486.64766, 57, 58, 62, 65, 68, 76, 78, 83, 98, 134, 138, 150, 154, (7%)70, (21%)100, (71%)1,000, (100%)
export_markupNo56,913.6706, (40%)10, (40%)100, (60%)1,000, (80%)
feedsNo1898.7870145, (11%)60, 70, (22%)100, (55%)1,000, (100%)
historyYes26189.271606, 41, 111, 273, (7%)150, 280, (11%)100, (30%)1,000, (100%)
indexNo13710.7356, (65%)10, (94%)100, (97%)1,000, (100%)
listYes6523,812.383997, 8, (9%)10, (30%)100, (41%)1,000, (52%)
lockedNo886.38836, (25%)10, (25%)100, (62%)1,000, (100%)
loginNo575606, 45, 61, 74, 194, (20%)10, 50, 70, 80, 200, (20%)100, (80%)1,000, (100%)
newNo257105.65716, (8%)70, (21%)100, (59%)1,000, (100%)
printYes44225.45123.57, (9%)10, (13%)100, (40%)1,000, (95%)
publishedYes2159.76316, 10, (14%)10, (38%)100, (71%)1,000, (100%)
recently_revisedYes1383.314730, (15%)30, (30%)100, (76%)1,000, (100%)
revisionYes1441,869.075126, (7%)10, (10%)100, (26%)1,000, (65%)
rollbackNo12215.75204.56, (25%)10, (25%)300, (33%)1,000, (100%)
saveNo3173,275.312,3512, (4%)10, (8%)100, (9%)2,000, (26%)
searchNo2538,951.3237,3026, 3205, 3280, 3321, 11143, 27917, 29498, 30562, 32806, 33487, 35045, 36931, 37303, 41620, 42212, 43264, 47044, 47591, 48431, 49106, 52529, 68064, 76626, 86279, 86538, (4%)10, 3210, 3280, 3330, 11150, 27920, 29500, 30570, 32810, 33490, 35050, 36940, 37310, 41620, 42220, 43270, 47050, 47600, 48440, 49110, 52530, 68070, 76630, 86280, 86540, (4%)3,300, (8%)4,000, (12%)
showNo51,666.256, (60%)10, (60%)100, (60%)1,000, (60%)
showYes5219388.92506, (6%)30, (12%)100, (66%)1,000, (89%)
texYes1390.31616, 21, 22, 23, 52, 60, 62, 73, 91, 94, 114, 161, 408, (7%)30, (23%)100, (76%)1,000, (100%)
web_listNo13331,338.1131,6096, (8%)10, (11%)100, (23%)1,000, (24%)

Note: recently_revised for the nlab itself is redirected by the web server to an internal page. The row in the table above is thus for all the other webs and so should not be compared with the row in the migrated nlab table as that is not redirected and so does include recently_revised for the nlab.

migrated nLab

TypeCachedRequestsMeanMedianMode (1)Mode (10)Mode (100)Mode (1000)
atom_with_contentYes124,140.423.54, (50%)10, (58%)100, (66%)1,000, (83%)
atom_with_headlinesYes12541.5840.54, (33%)10, (33%)100, (66%)1,000, (66%)
authorsYes82,261.751995, 67, 106, 138, 262, 305, 8352, 8867, (12%)10, 70, 110, 140, 270, 310, 8360, 8870, (12%)100, 200, (25%)1,000, (75%)
cancel_editNo919.8956, (55%)10, (88%)100, (88%)1,000, (100%)
editNo63368.7911757, (4%)60, (14%)100, (38%)1,000, (92%)
exportNo66854.536, 49, 51, 60, 98, 120, (16%)60, (33%)100, (83%)1,000, (100%)
feedsNo8134.2511051, 57, 107, 110, 112, 137, 202, 306, (12%)60, 110, (25%)200, (50%)1,000, (100%)
historyYes2191191137, 247, (50%)140, 250, (50%)200, 300, (50%)1,000, (100%)
indexNo4676.7423.54, (19%)10, (34%)100, (80%)1,000, (97%)
listYes244,270.294972,961, (8%)140, 2970, (8%)200, (16%)1,000, (70%)
lockedNo1084.469.547, 50, 56, 58, 65, 76, 119, 121, 127, 135, (10%)50, 60, 130, (20%)100, (60%)1,000, (100%)
loginNo4146.75101.554, 56, 149, 332, (25%)60, (50%)100, (50%)1,000, (100%)
newNo3361,989.638047, (3%)50, (19%)100, (52%)1,000, (97%)
recently_revisedYes323,515.591148, (18%)10, (31%)100, (40%)1,000, (65%)
revisionYes192,066.111,0884, (10%)10, (10%)100, 500, 1100, (10%)1,000, (42%)
saveNo232,118.221,5703, (8%)10, (8%)100, 900, (13%)1,000, (43%)
searchNo42,063.252,2141376, 2000, 2430, 2451, (25%)1380, 2000, 2430, 2460, (25%)2,500, (50%)2000, 3000, (50%)
showNo2223, (100%)10, (100%)100, (100%)1,000, (100%)
showYes19541,129.49368.56, (6%)10, (12%)100, (23%)1,000, (79%)
web_listNo35570.14566540, 636, (5%)540, (11%)600, (40%)1,000, (97%)

migrated nLab after xsendfile enabled (duh!)

TypeCachedRequestsMeanMedianMode (1)Mode (10)Mode (100)Mode (1000)
atom_with_headlinesYes331.67463, 47, 48, (33%)50, (66%)100, (100%)1,000, (100%)
authorsYes32,133.33634, 64, 6335, (33%)10, 70, 6340, (33%)100, (66%)1,000, (66%)
editNo389.337957, 80, 134, (33%)60, 80, 140, (33%)100, (66%)1,000, (100%)
exportNo2115.5115.5105, 128, (50%)110, 130, (50%)200, (100%)1,000, (100%)
feedsNo2434344, (100%)50, (100%)100, (100%)1,000, (100%)
indexNo2223, (100%)10, (100%)100, (100%)1,000, (100%)
listYes172,030.47424, (47%)10, (47%)100, (58%)1,000, (76%)
newNo410114.215245, (4%)50, (33%)100, (69%)1,000, (98%)
recently_revisedYes19677.111453, 4, (10%)10, (21%)100, (47%)1,000, (94%)
saveNo24,217.54,217.54009, 4428, (50%)4010, 4430, (50%)4100, 4500, (50%)5,000, (100%)
searchNo41,299.751,21345, 1025, 1403, 2730, (25%)50, 1030, 1410, 2730, (25%)100, 1100, 1500, 2800, (25%)2,000, (50%)
searchYes14,6404,6404,641, (100%)4,650, (100%)4,700, (100%)5,000, (100%)
showNo14,0774,0774,078, (100%)4,080, (100%)4,100, (100%)5,000, (100%)
showYes2087150.67104, (20%)10, (47%)100, (88%)1,000, (96%)
web_listNo2289289118, 462, (50%)120, 470, (50%)200, 500, (50%)1,000, (100%)

Mini Installation

TypeCachedRequestsMeanMedianMode (1)Mode (10)Mode (100)Mode (1000)
atom_with_contentYes31323.1687, (25%)10, (64%)100, (70%)1,000, (87%)
atom_with_headlinesYes4055.431512, (12%)20, (45%)100, (85%)1,000, (100%)
authorsYes2478.21518, (12%)10, (29%)100, (58%)1,000, (100%)
cancel_editNo825.52020, 27, (25%)20, (50%)100, (100%)1,000, (100%)
editNo96206.8213412, 13, (4%)20, (17%)100, (41%)1,000, (96%)
exportNo1080.88938, 39, 53, 65, 89, 91, 100, 111, 113, 119, (10%)120, (30%)100, (70%)1,000, (100%)
feedsNo1755.183738, (23%)40, (70%)100, (82%)1,000, (100%)
historyYes221721788, 348, (50%)90, 350, (50%)100, 400, (50%)1,000, (100%)
indexNo10249.56277, (6%)10, (22%)100, (88%)1,000, (100%)
listYes6371.13167, 9, (12%)10, (41%)100, (68%)1,000, (100%)
lockedNo24100.92109.5121, (8%)60, (16%)200, (54%)1,000, (100%)
newNo46389.02127.542, 43, 46, 56, (4%)50, (19%)100, (41%)1,000, (89%)
printYes2363.5363.594, 635, (50%)100, 640, (50%)100, 700, (50%)1,000, (100%)
recently_revisedYes4956.16108, 9, (14%)10, (42%)100, (79%)1,000, (100%)
revisionYes6153.33150.516, 121, 150, 153, 176, 310, (16%)20, 130, 150, 160, 180, 310, (16%)200, (66%)1,000, (100%)
saveNo51653.1299344, 515, (3%)140, (7%)200, (25%)1,000, (86%)
showNo1228228229, (100%)230, (100%)300, (100%)1,000, (100%)
showYes576110.682415, (7%)20, (41%)100, (79%)1,000, (97%)
texYes486.2566.534, 52, 83, 180, (25%)40, 60, 90, 180, (25%)100, (75%)1,000, (100%)

[Full link]
Last modified on:
Tue, 25th Aug 2009