In supplementary materials, I found that what types of GPUs are used to obtain the res

Thank you for your detailed response!! But, <a class="user-mention n

How much time is required to train the model?,about facebookresearch/ic_gan

Comments (3)

ArantxaCasanova commented on July 18, 2024 1

Hello, thank you for taking an interest!

Note that we trained with early stopping on the training FID metric, so the times indicated below have been computed using the elapsed time per epoch multiplied by the number of training epochs until the early stopping was triggered:

IC-GAN (BigGAN backbone) on ImageNet

64x64: ~ 14days
128x128: ~7 days
256x256 half cap: ~13 days
256x256 full capacity: ~14 days

Class-conditional IC-GAN (BigGAN backbone) on ImageNet
64x64: ~12 days
128x128: ~4 days
256x256 half capacity: ~10days
256x256 full capacity: ~10days

Note that the experiments at 64x64 present a mostly flat FID curve for most of the time, but due to the early stopping it takes some time to finally get them to a halt. In practice, training for 25-30% of the specified time above for the 64x64 resolution (3-4 days) would result in a very close FID metric to the ones reported in the paper.

IC-GAN (StyleGAN backbone) on COCO-Stuff
128x128: ~4 days
256x256: ~7days

Same as before, training for ~50% of the time indicated above should result in a very similar FID metric.

from ic_gan.

shim94kr commented on July 18, 2024

Thank you for your detailed response!!

But, @ArantxaCasanova, when I had run the code for ICGAN on ImageNet using BigGAN for three days using TITANRTX, which shows similar performance to V100, I obtained FID near 14~, which is expected to be around 9.2 according to the paper and your response. Can you check my log below to see whether it is correct? I did not change the code and run the default setup of icgan_res64.json.

icgan_biggan_imagenet_res64_log.jsonl                                                                                                                                               
   1 {"itr": 1251, "IS_mean": 2.2318460941314697, "IS_std": 0.009752069599926472, "FID": 180.53466796875, "_stamp": 1640096006.5100703}
   2 {"itr": 2502, "IS_mean": 3.958350419998169, "IS_std": 0.03428145498037338, "FID": 101.74240112304688, "_stamp": 1640097940.2660592}
   3 {"itr": 3753, "IS_mean": 5.210995197296143, "IS_std": 0.08762586116790771, "FID": 83.91567993164062, "_stamp": 1640099884.3449478}
   4 {"itr": 5004, "IS_mean": 5.384078025817871, "IS_std": 0.057966094464063644, "FID": 71.87924194335938, "_stamp": 1640101831.5436141}
   5 {"itr": 6255, "IS_mean": 6.04024600982666, "IS_std": 0.0690140575170517, "FID": 67.22817993164062, "_stamp": 1640103775.642912}
   6 {"itr": 7506, "IS_mean": 4.737320899963379, "IS_std": 0.054880931973457336, "FID": 82.885009765625, "_stamp": 1640105712.8800218}
   7 {"itr": 8757, "IS_mean": 6.367566108703613, "IS_std": 0.0761653333902359, "FID": 68.68673706054688, "_stamp": 1640107656.3787503}
   8 {"itr": 10008, "IS_mean": 6.5610527992248535, "IS_std": 0.08599968254566193, "FID": 63.7291259765625, "_stamp": 1640109599.3269897}
   9 {"itr": 11259, "IS_mean": 6.449869632720947, "IS_std": 0.05051097646355629, "FID": 63.16119384765625, "_stamp": 1640111538.439733}
  10 {"itr": 12510, "IS_mean": 5.846770286560059, "IS_std": 0.1061834841966629, "FID": 72.1973876953125, "_stamp": 1640113477.851108}
  11 {"itr": 13761, "IS_mean": 7.02129602432251, "IS_std": 0.08278453350067139, "FID": 59.38818359375, "_stamp": 1640115420.0891662}
  12 {"itr": 15012, "IS_mean": 7.372344017028809, "IS_std": 0.08931285887956619, "FID": 57.5106201171875, "_stamp": 1640117358.5442476}
  13 {"itr": 16263, "IS_mean": 7.860313415527344, "IS_std": 0.06799346208572388, "FID": 53.882537841796875, "_stamp": 1640119292.5362747}
  14 {"itr": 17514, "IS_mean": 7.8017144203186035, "IS_std": 0.14893615245819092, "FID": 53.074188232421875, "_stamp": 1640121222.2017548}
  15 {"itr": 18765, "IS_mean": 7.879268646240234, "IS_std": 0.1238294392824173, "FID": 52.62994384765625, "_stamp": 1640123160.3043122}
  16 {"itr": 20016, "IS_mean": 8.202924728393555, "IS_std": 0.13499438762664795, "FID": 51.249908447265625, "_stamp": 1640125098.0948894}
  17 {"itr": 21267, "IS_mean": 8.639143943786621, "IS_std": 0.13311155140399933, "FID": 47.82415771484375, "_stamp": 1640127032.0776186}
  18 {"itr": 22518, "IS_mean": 9.312200546264648, "IS_std": 0.1118660569190979, "FID": 44.180816650390625, "_stamp": 1640128967.9635065}
  19 {"itr": 23769, "IS_mean": 9.934118270874023, "IS_std": 0.18069873750209808, "FID": 40.864715576171875, "_stamp": 1640130904.7850666}
  20 {"itr": 25020, "IS_mean": 10.51250171661377, "IS_std": 0.12734396755695343, "FID": 38.13330078125, "_stamp": 1640132840.5347116}
  21 {"itr": 26271, "IS_mean": 10.905808448791504, "IS_std": 0.19149009883403778, "FID": 35.86822509765625, "_stamp": 1640134776.3376288}
  22 {"itr": 27522, "IS_mean": 11.526442527770996, "IS_std": 0.18941688537597656, "FID": 34.208526611328125, "_stamp": 1640136715.44007}
  23 {"itr": 28773, "IS_mean": 11.894376754760742, "IS_std": 0.15926891565322876, "FID": 32.69781494140625, "_stamp": 1640138650.7913828}
  24 {"itr": 30024, "IS_mean": 12.33474063873291, "IS_std": 0.2318120002746582, "FID": 31.05364990234375, "_stamp": 1640140591.9328012}
  25 {"itr": 31275, "IS_mean": 12.751044273376465, "IS_std": 0.3106596767902374, "FID": 29.908447265625, "_stamp": 1640142528.9601877}
  26 {"itr": 32526, "IS_mean": 12.969266891479492, "IS_std": 0.24372565746307373, "FID": 28.603729248046875, "_stamp": 1640144464.9841723}
  27 {"itr": 33777, "IS_mean": 13.33903694152832, "IS_std": 0.15685021877288818, "FID": 27.48284912109375, "_stamp": 1640146402.7955701}
  28 {"itr": 35028, "IS_mean": 13.563314437866211, "IS_std": 0.27210965752601624, "FID": 26.665740966796875, "_stamp": 1640148340.1834116}
  29 {"itr": 36279, "IS_mean": 14.024259567260742, "IS_std": 0.23603327572345734, "FID": 25.550018310546875, "_stamp": 1640150278.2995749}
  30 {"itr": 37530, "IS_mean": 14.089932441711426, "IS_std": 0.14803865551948547, "FID": 24.798553466796875, "_stamp": 1640152214.6450374}
  31 {"itr": 38781, "IS_mean": 14.533788681030273, "IS_std": 0.16761167347431183, "FID": 24.058807373046875, "_stamp": 1640154153.28619}
  32 {"itr": 40032, "IS_mean": 14.700818061828613, "IS_std": 0.21465186774730682, "FID": 23.35784912109375, "_stamp": 1640156100.508716}
  33 {"itr": 41283, "IS_mean": 14.947118759155273, "IS_std": 0.19010241329669952, "FID": 22.691650390625, "_stamp": 1640158038.9081755}
  34 {"itr": 42534, "IS_mean": 15.091265678405762, "IS_std": 0.18537811934947968, "FID": 22.107666015625, "_stamp": 1640159973.6137385}
  35 {"itr": 43785, "IS_mean": 15.526232719421387, "IS_std": 0.2867591083049774, "FID": 21.5811767578125, "_stamp": 1640161908.093581}
  36 {"itr": 45036, "IS_mean": 15.420428276062012, "IS_std": 0.2635813057422638, "FID": 21.23516845703125, "_stamp": 1640163840.2401881}
  37 {"itr": 46287, "IS_mean": 15.811836242675781, "IS_std": 0.3227626383304596, "FID": 20.64239501953125, "_stamp": 1640165776.267094}
  38 {"itr": 47538, "IS_mean": 15.943559646606445, "IS_std": 0.3127444088459015, "FID": 20.31231689453125, "_stamp": 1640167714.6316702}
  39 {"itr": 48789, "IS_mean": 15.905792236328125, "IS_std": 0.1740894913673401, "FID": 20.265167236328125, "_stamp": 1640169646.6215327}
  40 {"itr": 50040, "IS_mean": 16.202192306518555, "IS_std": 0.34515145421028137, "FID": 19.73272705078125, "_stamp": 1640171582.626681}
  41 {"itr": 51291, "IS_mean": 16.1182804107666, "IS_std": 0.31110548973083496, "FID": 19.42645263671875, "_stamp": 1640173516.8503034}
  42 {"itr": 52542, "IS_mean": 16.25514793395996, "IS_std": 0.23447400331497192, "FID": 19.096893310546875, "_stamp": 1640175455.2564235}
  43 {"itr": 53793, "IS_mean": 16.30306053161621, "IS_std": 0.2424468845129013, "FID": 19.0076904296875, "_stamp": 1640177388.7415648}
  44 {"itr": 55044, "IS_mean": 16.44534683227539, "IS_std": 0.3165159225463867, "FID": 18.762237548828125, "_stamp": 1640179323.1608982}
  45 {"itr": 56295, "IS_mean": 16.361780166625977, "IS_std": 0.26025062799453735, "FID": 18.544769287109375, "_stamp": 1640181260.0689518}
  46 {"itr": 57546, "IS_mean": 16.472171783447266, "IS_std": 0.44301480054855347, "FID": 18.301605224609375, "_stamp": 1640183196.6069674}
  47 {"itr": 58797, "IS_mean": 16.414165496826172, "IS_std": 0.25418275594711304, "FID": 18.3548583984375, "_stamp": 1640185127.1917155}
  48 {"itr": 60048, "IS_mean": 16.778240203857422, "IS_std": 0.23148734867572784, "FID": 18.069000244140625, "_stamp": 1640187067.2973309}
  49 {"itr": 61299, "IS_mean": 16.802227020263672, "IS_std": 0.284844309091568, "FID": 18.00103759765625, "_stamp": 1640189006.7526677}
  50 {"itr": 62550, "IS_mean": 16.734773635864258, "IS_std": 0.16143545508384705, "FID": 17.80633544921875, "_stamp": 1640190940.8461123}
  51 {"itr": 63801, "IS_mean": 16.800649642944336, "IS_std": 0.25399431586265564, "FID": 17.604156494140625, "_stamp": 1640192875.5948458}
  52 {"itr": 65052, "IS_mean": 16.658777236938477, "IS_std": 0.22733555734157562, "FID": 17.64874267578125, "_stamp": 1640194810.210066}
  53 {"itr": 66303, "IS_mean": 16.701534271240234, "IS_std": 0.31976887583732605, "FID": 17.56036376953125, "_stamp": 1640196740.8758187}
  54 {"itr": 67554, "IS_mean": 16.853776931762695, "IS_std": 0.3126715421676636, "FID": 17.512298583984375, "_stamp": 1640198675.5203135}
  55 {"itr": 68805, "IS_mean": 16.9285888671875, "IS_std": 0.3644414246082306, "FID": 17.22906494140625, "_stamp": 1640200608.089111}
  56 {"itr": 70056, "IS_mean": 16.961254119873047, "IS_std": 0.2552907466888428, "FID": 17.355560302734375, "_stamp": 1640202542.6564436}
  57 {"itr": 71307, "IS_mean": 16.85753059387207, "IS_std": 0.3124605715274811, "FID": 17.062103271484375, "_stamp": 1640204473.2083814}
  58 {"itr": 72558, "IS_mean": 16.842369079589844, "IS_std": 0.26436007022857666, "FID": 17.1773681640625, "_stamp": 1640206403.9596965}
  59 {"itr": 73809, "IS_mean": 16.862346649169922, "IS_std": 0.2265423685312271, "FID": 17.0284423828125, "_stamp": 1640208337.681965}
  60 {"itr": 75060, "IS_mean": 16.999563217163086, "IS_std": 0.26454052329063416, "FID": 16.871795654296875, "_stamp": 1640210272.7560096}
  61 {"itr": 76311, "IS_mean": 17.082027435302734, "IS_std": 0.31104427576065063, "FID": 16.66400146484375, "_stamp": 1640212208.3567913}
  62 {"itr": 77562, "IS_mean": 17.06978416442871, "IS_std": 0.5159571766853333, "FID": 16.76861572265625, "_stamp": 1640214139.8075774}
  63 {"itr": 78813, "IS_mean": 17.129878997802734, "IS_std": 0.35020676255226135, "FID": 16.50946044921875, "_stamp": 1640216074.9952865}
  64 {"itr": 80064, "IS_mean": 17.367162704467773, "IS_std": 0.41433900594711304, "FID": 16.32305908203125, "_stamp": 1640218009.6763082}
  65 {"itr": 81315, "IS_mean": 17.059574127197266, "IS_std": 0.23937414586544037, "FID": 16.49432373046875, "_stamp": 1640219941.8636005}
  66 {"itr": 82566, "IS_mean": 17.2658748626709, "IS_std": 0.32964563369750977, "FID": 16.294921875, "_stamp": 1640221872.9383447}
  67 {"itr": 83817, "IS_mean": 17.01615333557129, "IS_std": 0.3158760070800781, "FID": 16.2088623046875, "_stamp": 1640223804.2240167}
  68 {"itr": 85068, "IS_mean": 17.23769760131836, "IS_std": 0.1996530443429947, "FID": 16.078216552734375, "_stamp": 1640225738.4019864}
  69 {"itr": 86319, "IS_mean": 17.314964294433594, "IS_std": 0.31797459721565247, "FID": 16.0335693359375, "_stamp": 1640227678.7168062}
  70 {"itr": 87570, "IS_mean": 17.40017318725586, "IS_std": 0.30815568566322327, "FID": 15.95867919921875, "_stamp": 1640229617.4759316}
  71 {"itr": 88821, "IS_mean": 17.489559173583984, "IS_std": 0.3001735210418701, "FID": 15.77191162109375, "_stamp": 1640231552.8729591}
  72 {"itr": 90072, "IS_mean": 17.46316146850586, "IS_std": 0.2988584041595459, "FID": 15.858306884765625, "_stamp": 1640233485.338514}
  73 {"itr": 91323, "IS_mean": 17.37122344970703, "IS_std": 0.29717108607292175, "FID": 15.911529541015625, "_stamp": 1640235415.8562195}
  74 {"itr": 92574, "IS_mean": 17.471813201904297, "IS_std": 0.2992657721042633, "FID": 15.668701171875, "_stamp": 1640237349.6483262}
  75 {"itr": 93825, "IS_mean": 17.449811935424805, "IS_std": 0.3002367317676544, "FID": 15.615325927734375, "_stamp": 1640239290.051686}
  76 {"itr": 95076, "IS_mean": 17.49803352355957, "IS_std": 0.2948966324329376, "FID": 15.5396728515625, "_stamp": 1640241241.5869231}
  77 {"itr": 96327, "IS_mean": 17.52846336364746, "IS_std": 0.3161499798297882, "FID": 15.46051025390625, "_stamp": 1640243184.4794703}
  78 {"itr": 97578, "IS_mean": 17.536632537841797, "IS_std": 0.3090992867946625, "FID": 15.5965576171875, "_stamp": 1640245125.5671654}
  79 {"itr": 98829, "IS_mean": 17.526931762695312, "IS_std": 0.29878491163253784, "FID": 15.5257568359375, "_stamp": 1640247064.6960237}
  80 {"itr": 100080, "IS_mean": 17.495676040649414, "IS_std": 0.27174362540245056, "FID": 15.431121826171875, "_stamp": 1640249004.78831}
  81 {"itr": 101331, "IS_mean": 17.690767288208008, "IS_std": 0.27449125051498413, "FID": 15.28839111328125, "_stamp": 1640250952.6077292}
  82 {"itr": 102582, "IS_mean": 17.59381675720215, "IS_std": 0.2719765901565552, "FID": 15.413604736328125, "_stamp": 1640252897.5051908}
  83 {"itr": 103833, "IS_mean": 17.675708770751953, "IS_std": 0.3517760932445526, "FID": 15.295989990234375, "_stamp": 1640254842.2679873}
  84 {"itr": 105084, "IS_mean": 17.640613555908203, "IS_std": 0.344858855009079, "FID": 15.40301513671875, "_stamp": 1640256785.6069996}
  85 {"itr": 106335, "IS_mean": 17.576976776123047, "IS_std": 0.4207572042942047, "FID": 15.32659912109375, "_stamp": 1640258728.744894}
  86 {"itr": 107586, "IS_mean": 17.80357551574707, "IS_std": 0.16497570276260376, "FID": 15.158111572265625, "_stamp": 1640260669.5040276}
  87 {"itr": 108837, "IS_mean": 17.664493560791016, "IS_std": 0.3261367678642273, "FID": 15.30352783203125, "_stamp": 1640262600.3489325}
  88 {"itr": 110088, "IS_mean": 17.927045822143555, "IS_std": 0.31048402190208435, "FID": 14.985198974609375, "_stamp": 1640264538.6661491}
  89 {"itr": 111339, "IS_mean": 17.781227111816406, "IS_std": 0.23087291419506073, "FID": 15.1705322265625, "_stamp": 1640266472.0305507}
  90 {"itr": 112590, "IS_mean": 17.73124122619629, "IS_std": 0.19884145259857178, "FID": 15.185394287109375, "_stamp": 1640268404.269387}
  91 {"itr": 113841, "IS_mean": 17.651399612426758, "IS_std": 0.23656447231769562, "FID": 15.26654052734375, "_stamp": 1640270338.5326943}
  92 {"itr": 115092, "IS_mean": 17.760698318481445, "IS_std": 0.33739790320396423, "FID": 15.15972900390625, "_stamp": 1640272272.3711853}
  93 {"itr": 116343, "IS_mean": 17.81930160522461, "IS_std": 0.1878114640712738, "FID": 15.03472900390625, "_stamp": 1640274203.2622182}
  94 {"itr": 117594, "IS_mean": 17.581769943237305, "IS_std": 0.20925608277320862, "FID": 15.1552734375, "_stamp": 1640276139.0490508}
  95 {"itr": 118845, "IS_mean": 17.795894622802734, "IS_std": 0.37166011333465576, "FID": 14.9603271484375, "_stamp": 1640278074.5118158}
  96 {"itr": 120096, "IS_mean": 17.831785202026367, "IS_std": 0.3402048349380493, "FID": 14.97418212890625, "_stamp": 1640280011.9436018}
  97 {"itr": 121347, "IS_mean": 17.885297775268555, "IS_std": 0.2875950336456299, "FID": 14.846710205078125, "_stamp": 1640281947.2325683}
  98 {"itr": 122598, "IS_mean": 17.852970123291016, "IS_std": 0.2541261315345764, "FID": 14.9144287109375, "_stamp": 1640283877.6436849}
  99 {"itr": 123849, "IS_mean": 18.04885482788086, "IS_std": 0.31134456396102905, "FID": 14.8358154296875, "_stamp": 1640285813.0839205}
 100 {"itr": 125100, "IS_mean": 17.882701873779297, "IS_std": 0.23045842349529266, "FID": 14.84234619140625, "_stamp": 1640287745.8034174}
 101 {"itr": 126351, "IS_mean": 17.788516998291016, "IS_std": 0.3526589572429657, "FID": 14.864654541015625, "_stamp": 1640289676.5190356}
 102 {"itr": 127602, "IS_mean": 18.019319534301758, "IS_std": 0.3290066719055176, "FID": 14.9063720703125, "_stamp": 1640291607.2814085}
 103 {"itr": 128853, "IS_mean": 17.914196014404297, "IS_std": 0.11040227860212326, "FID": 14.841705322265625, "_stamp": 1640293539.8969824}
 104 {"itr": 130104, "IS_mean": 18.05310821533203, "IS_std": 0.30288204550743103, "FID": 14.8099365234375, "_stamp": 1640295473.8347797}
 105 {"itr": 131355, "IS_mean": 18.055923461914062, "IS_std": 0.3790058493614197, "FID": 14.741973876953125, "_stamp": 1640297405.8238847}
 106 {"itr": 132606, "IS_mean": 18.017208099365234, "IS_std": 0.19398662447929382, "FID": 14.680206298828125, "_stamp": 1640299336.394594}
 107 {"itr": 133857, "IS_mean": 17.941953659057617, "IS_std": 0.26211538910865784, "FID": 14.79736328125, "_stamp": 1640301267.1709063}
 108 {"itr": 135108, "IS_mean": 17.897968292236328, "IS_std": 0.20858265459537506, "FID": 14.7686767578125, "_stamp": 1640303199.1181893}
 109 {"itr": 136359, "IS_mean": 18.133739471435547, "IS_std": 0.25351518392562866, "FID": 14.612701416015625, "_stamp": 1640305134.0437696}
 110 {"itr": 137610, "IS_mean": 17.96592140197754, "IS_std": 0.23823757469654083, "FID": 14.561737060546875, "_stamp": 1640307064.230492}
 111 {"itr": 138861, "IS_mean": 17.950193405151367, "IS_std": 0.28612759709358215, "FID": 14.631866455078125, "_stamp": 1640308996.1320179}
 112 {"itr": 140112, "IS_mean": 18.051673889160156, "IS_std": 0.25064048171043396, "FID": 14.4461669921875, "_stamp": 1640310926.953079}
 113 {"itr": 141363, "IS_mean": 18.05769920349121, "IS_std": 0.19991852343082428, "FID": 14.41973876953125, "_stamp": 1640312857.1292958}
 114 {"itr": 142614, "IS_mean": 18.043554306030273, "IS_std": 0.32386794686317444, "FID": 14.477294921875, "_stamp": 1640314788.6372974}
 115 {"itr": 143865, "IS_mean": 17.763418197631836, "IS_std": 0.29215100407600403, "FID": 14.477386474609375, "_stamp": 1640316718.9019053}
 116 {"itr": 145116, "IS_mean": 17.883663177490234, "IS_std": 0.31485995650291443, "FID": 14.37457275390625, "_stamp": 1640318650.2290452}
 117 {"itr": 146367, "IS_mean": 18.016878128051758, "IS_std": 0.1615576297044754, "FID": 14.3809814453125, "_stamp": 1640320580.102304}
 118 {"itr": 147618, "IS_mean": 18.1309871673584, "IS_std": 0.18823616206645966, "FID": 14.251434326171875, "_stamp": 1640322511.7728558}
 119 {"itr": 148869, "IS_mean": 17.775806427001953, "IS_std": 0.15346559882164001, "FID": 14.3265380859375, "_stamp": 1640324445.204774}
 120 {"itr": 150120, "IS_mean": 17.9442081451416, "IS_std": 0.14428454637527466, "FID": 14.2178955078125, "_stamp": 1640326374.475005}
 121 {"itr": 151371, "IS_mean": 17.744308471679688, "IS_std": 0.27344346046447754, "FID": 14.40167236328125, "_stamp": 1640328302.1385856}
 122 {"itr": 152622, "IS_mean": 18.03793716430664, "IS_std": 0.2198096662759781, "FID": 14.463775634765625, "_stamp": 1640330231.9493105}
 123 {"itr": 153873, "IS_mean": 17.935436248779297, "IS_std": 0.34770697355270386, "FID": 14.299835205078125, "_stamp": 1640332161.5390532}
 124 {"itr": 155124, "IS_mean": 17.885643005371094, "IS_std": 0.19925306737422943, "FID": 14.231201171875, "_stamp": 1640334090.0921419}
 125 {"itr": 156375, "IS_mean": 17.872894287109375, "IS_std": 0.3444492816925049, "FID": 14.129547119140625, "_stamp": 1640336018.9095397}
 126 {"itr": 157626, "IS_mean": 17.981109619140625, "IS_std": 0.21017670631408691, "FID": 14.104705810546875, "_stamp": 1640337948.3117435}
 127 {"itr": 158877, "IS_mean": 17.950571060180664, "IS_std": 0.26038914918899536, "FID": 14.14508056640625, "_stamp": 1640339877.1570477}
 128 {"itr": 160128, "IS_mean": 17.982757568359375, "IS_std": 0.2493799477815628, "FID": 14.09381103515625, "_stamp": 1640341804.8566086}
 129 {"itr": 161379, "IS_mean": 17.994943618774414, "IS_std": 0.2745615541934967, "FID": 14.061126708984375, "_stamp": 1640343731.3729534}
 130 {"itr": 162630, "IS_mean": 18.04806900024414, "IS_std": 0.25510334968566895, "FID": 13.99884033203125, "_stamp": 1640345662.5216582}
 131 {"itr": 163881, "IS_mean": 18.136789321899414, "IS_std": 0.18847626447677612, "FID": 14.050750732421875, "_stamp": 1640347591.7090538}
 132 {"itr": 165132, "IS_mean": 17.91263771057129, "IS_std": 0.3068874180316925, "FID": 14.055084228515625, "_stamp": 1640349519.7111874}
 133 {"itr": 166383, "IS_mean": 17.95224952697754, "IS_std": 0.3425128757953644, "FID": 14.122467041015625, "_stamp": 1640351451.5465536}
 134 {"itr": 167634, "IS_mean": 18.079477310180664, "IS_std": 0.21193139255046844, "FID": 14.100372314453125, "_stamp": 1640353382.8038242}
 135 {"itr": 168885, "IS_mean": 18.02048110961914, "IS_std": 0.28216955065727234, "FID": 14.1148681640625, "_stamp": 1640355310.0499413}
 136 {"itr": 170136, "IS_mean": 18.09942054748535, "IS_std": 0.17239074409008026, "FID": 13.99713134765625, "_stamp": 1640357238.6131868}
 137 {"itr": 171387, "IS_mean": 18.170801162719727, "IS_std": 0.27883365750312805, "FID": 14.08721923828125, "_stamp": 1640359168.7833025}
 138 {"itr": 172638, "IS_mean": 18.07349395751953, "IS_std": 0.41554346680641174, "FID": 13.99908447265625, "_stamp": 1640361095.2189047}
 139 {"itr": 173889, "IS_mean": 17.989665985107422, "IS_std": 0.3695733845233917, "FID": 14.003143310546875, "_stamp": 1640363021.1289816}
 140 {"itr": 175140, "IS_mean": 17.91567039489746, "IS_std": 0.2742043137550354, "FID": 14.138427734375, "_stamp": 1640364948.4102814}
 141 {"itr": 176391, "IS_mean": 18.05159568786621, "IS_std": 0.2769652307033539, "FID": 13.968536376953125, "_stamp": 1640366878.6514797}
 142 {"itr": 177642, "IS_mean": 18.184436798095703, "IS_std": 0.24356293678283691, "FID": 13.830047607421875, "_stamp": 1640368811.2520459}
 143 {"itr": 178893, "IS_mean": 18.106529235839844, "IS_std": 0.37988242506980896, "FID": 13.84326171875, "_stamp": 1640370738.5631275}
 144 {"itr": 180144, "IS_mean": 18.266536712646484, "IS_std": 0.2798824906349182, "FID": 13.7618408203125, "_stamp": 1640372670.0439632}
 145 {"itr": 181395, "IS_mean": 18.079618453979492, "IS_std": 0.2592574656009674, "FID": 13.8729248046875, "_stamp": 1640374596.3919265}
 146 {"itr": 182646, "IS_mean": 18.102214813232422, "IS_std": 0.12982456386089325, "FID": 13.872528076171875, "_stamp": 1640376524.9517636}
 147 {"itr": 183897, "IS_mean": 18.124446868896484, "IS_std": 0.3137153685092926, "FID": 13.928955078125, "_stamp": 1640378455.5919557}
 148 {"itr": 185148, "IS_mean": 18.04410171508789, "IS_std": 0.27717655897140503, "FID": 13.799407958984375, "_stamp": 1640380385.5629992}
 149 {"itr": 186399, "IS_mean": 18.21609878540039, "IS_std": 0.3581992983818054, "FID": 13.70843505859375, "_stamp": 1640382316.4325929}
 150 {"itr": 187650, "IS_mean": 18.075927734375, "IS_std": 0.19388924539089203, "FID": 13.76385498046875, "_stamp": 1640384245.1413317}
 151 {"itr": 188901, "IS_mean": 18.14574432373047, "IS_std": 0.11410395801067352, "FID": 13.719970703125, "_stamp": 1640386181.324028}
 152 {"itr": 190152, "IS_mean": 18.236513137817383, "IS_std": 0.24511007964611053, "FID": 13.77044677734375, "_stamp": 1640388112.9648633}
 153 {"itr": 191403, "IS_mean": 18.342544555664062, "IS_std": 0.26481959223747253, "FID": 13.659027099609375, "_stamp": 1640390047.2995188}
 154 {"itr": 192654, "IS_mean": 18.36556053161621, "IS_std": 0.3265049457550049, "FID": 13.6241455078125, "_stamp": 1640391987.5524623}
 155 {"itr": 193905, "IS_mean": 18.13161849975586, "IS_std": 0.33017849922180176, "FID": 13.755279541015625, "_stamp": 1640393920.8134701}
 156 {"itr": 195156, "IS_mean": 18.31369400024414, "IS_std": 0.25095096230506897, "FID": 13.597076416015625, "_stamp": 1640395854.5921926}
 157 {"itr": 196407, "IS_mean": 18.216201782226562, "IS_std": 0.31194519996643066, "FID": 13.6502685546875, "_stamp": 1640397791.1541271}

from ic_gan.

ArantxaCasanova commented on July 18, 2024

I did check your log, and here is a plot to show you how the curve looks like with respect to one of my runs

user_run is the log you pasted, and icgan_res64_augfeats_hflips is my full run. As you can see, it follows the same trend.

As an additional note, remember that the numbers reported in the paper are obtained with the tensorflow FID code and conditioning on only 1000 feature vectors selected with K-means. The FIDs logged during training are only used to monitor training and meant to compare experiments with each other, not to report the final results.

For more details, refer to: https://github.com/facebookresearch/ic_gan#how-to-test-the-models.

from ic_gan.

How much time is required to train the model? about ic_gan HOT 3 OPEN

Comments (3)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent