{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,4,3]],"date-time":"2022-04-03T14:50:52Z","timestamp":1648997452972},"reference-count":71,"publisher":"World Scientific Pub Co Pte Ltd","issue":"08","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2021,8]]},"abstract":" Parallel test forms are ubiquitous in the educational, aptitude, achievement, and licensure testing. The problem of automated assembling of parallel test forms has been extensively explored for almost 40 years. Many different mathematical models of the problem formulations and a plenty of different solutions have emerged over the last two decades, indicating that the problem has matured. However, its investigation is still challenging, especially today, when the importance of distance learning and remote knowledge testing is rapidly growing. The diversity of proposed approaches originated notably from the variety of scientific fields involved such as psychometrics, applied mathematics, operations research, and artificial intelligence. Majority of solutions of the problem are (meta)heuristics-based, since they consider the problem as a combinatorial optimization problem which is NP-hard. In this paper, a comprehensive review of this research field, referring to related works since 1985, is conducted. Problem formulations and solutions of the problem are separately classified. Possible avenues of future research are pointed out. <\/jats:p>","DOI":"10.1142\/s0218194021500376","type":"journal-article","created":{"date-parts":[[2021,9,17]],"date-time":"2021-09-17T08:32:35Z","timestamp":1631867555000},"page":"1171-1212","source":"Crossref","is-referenced-by-count":0,"title":["A Survey on Problem Formulations and (Meta)Heuristic-Based Solutions in Automated Assembly of Parallel Test Forms"],"prefix":"10.1142","volume":"31","author":[{"given":"Miroslava M.","family":"Ignjatovi\u0107","sequence":"first","affiliation":[{"name":"School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia"}]},{"given":"Dragan M.","family":"Boji\u0107","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia"}]},{"given":"Igor I.","family":"Tartalja","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia"}]}],"member":"219","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"S0218194021500376BIB001","doi-asserted-by":"publisher","DOI":"10.1177\/014662168601000401"},{"key":"S0218194021500376BIB002","doi-asserted-by":"publisher","DOI":"10.1007\/BF02294518"},{"key":"S0218194021500376BIB003","doi-asserted-by":"publisher","DOI":"10.1007\/0-387-29054-0"},{"key":"S0218194021500376BIB004","first-page":"125","volume-title":"Application of Artificial Intelligence to Assessment","author":"Chuah S. C.","year":"2020"},{"key":"S0218194021500376BIB005","volume-title":"Stochastic Local Search: Foundations and Applications","author":"Holger H. H.","year":"2004"},{"key":"S0218194021500376BIB006","first-page":"101","volume":"1","author":"Boekkooi-Timminga E.","year":"1987","journal-title":"Methodika"},{"key":"S0218194021500376BIB007","doi-asserted-by":"publisher","DOI":"10.1177\/0146621617695523"},{"key":"S0218194021500376BIB008","doi-asserted-by":"publisher","DOI":"10.1007\/BF02296260"},{"key":"S0218194021500376BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-012-1175-5"},{"key":"S0218194021500376BIB010","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.01.057"},{"key":"S0218194021500376BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2013.2297694"},{"key":"S0218194021500376BIB012","doi-asserted-by":"publisher","DOI":"10.1007\/s10589-005-3058-z"},{"key":"S0218194021500376BIB013","doi-asserted-by":"publisher","DOI":"10.1126\/science.220.4598.671"},{"key":"S0218194021500376BIB014","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.1.3.190"},{"key":"S0218194021500376BIB015","doi-asserted-by":"publisher","DOI":"10.1137\/0202009"},{"key":"S0218194021500376BIB016","doi-asserted-by":"publisher","DOI":"10.1016\/B978-008045157-2\/50081-X"},{"key":"S0218194021500376BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/S0305-0548(97)00031-2"},{"key":"S0218194021500376BIB019","series-title":"Chinese American Educational Research and Development Association Book Series","first-page":"3","volume-title":"Advancing Methodologies to Support Both Summative and Formative Assessments","author":"Belov D. I.","year":"2014"},{"key":"S0218194021500376BIB020","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12262"},{"key":"S0218194021500376BIB022","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.44.6.922"},{"key":"S0218194021500376BIB023","doi-asserted-by":"publisher","DOI":"10.1002\/sim.5936"},{"key":"S0218194021500376BIB024","doi-asserted-by":"publisher","DOI":"10.2307\/1412159"},{"key":"S0218194021500376BIB025","doi-asserted-by":"publisher","DOI":"10.1007\/BF02310555"},{"key":"S0218194021500376BIB026","doi-asserted-by":"publisher","DOI":"10.3102\/10769986014003279"},{"key":"S0218194021500376BIB027","volume-title":"Statistical Theories of Mental Test Scores","author":"Lord F. M.","year":"2008"},{"key":"S0218194021500376BIB028","volume-title":"Applications of Item Response Theory to Practical Testing Problems","author":"Lord F. M.","year":"1980"},{"issue":"3","key":"S0218194021500376BIB029","first-page":"273","volume":"61","author":"Lawley D. N.","year":"1943","journal-title":"Proc. R. Soc. Edinb. A, Math."},{"key":"S0218194021500376BIB030","first-page":"395","volume-title":"Statistical Theories of Mental Test Scores","author":"Birnbaum A.","year":"2008"},{"key":"S0218194021500376BIB031","doi-asserted-by":"publisher","DOI":"10.1177\/0013164498058003001"},{"key":"S0218194021500376BIB032","volume-title":"Proc. Annu. Conf. National Council on Measurement in Education","author":"Davey T.","year":"2010"},{"issue":"8","key":"S0218194021500376BIB033","first-page":"3","volume":"6","author":"Lin C. J.","year":"2008","journal-title":"J. Technol. Learn. Assess."},{"key":"S0218194021500376BIB034","first-page":"123","volume-title":"Application of Item Response Theory","author":"Yen W. M.","year":"1983"},{"key":"S0218194021500376BIB035","doi-asserted-by":"publisher","DOI":"10.3102\/10769986015002129"},{"key":"S0218194021500376BIB036","doi-asserted-by":"publisher","DOI":"10.1007\/BF02294048"},{"key":"S0218194021500376BIB037","doi-asserted-by":"publisher","DOI":"10.2307\/1910129"},{"key":"S0218194021500376BIB038","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(91)90195-2"},{"key":"S0218194021500376BIB040","doi-asserted-by":"publisher","DOI":"10.1177\/014662169301700205"},{"key":"S0218194021500376BIB041","doi-asserted-by":"publisher","DOI":"10.1177\/014662169301700206"},{"key":"S0218194021500376BIB042","doi-asserted-by":"publisher","DOI":"10.1177\/01466216980223003"},{"key":"S0218194021500376BIB043","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2010.29"},{"key":"S0218194021500376BIB044","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1998.tb00533.x"},{"key":"S0218194021500376BIB045","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-011-0308-x"},{"key":"S0218194021500376BIB046","doi-asserted-by":"publisher","DOI":"10.1080\/08957340801926151"},{"key":"S0218194021500376BIB047","doi-asserted-by":"publisher","DOI":"10.1177\/014662168601000406"},{"key":"S0218194021500376BIB048","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2012.22"},{"key":"S0218194021500376BIB049","doi-asserted-by":"publisher","DOI":"10.1177\/014662169201600106"},{"key":"S0218194021500376BIB050","doi-asserted-by":"publisher","DOI":"10.1137\/0117039"},{"key":"S0218194021500376BIB051","doi-asserted-by":"publisher","DOI":"10.3102\/10769986019001073"},{"issue":"3","key":"S0218194021500376BIB052","first-page":"3","volume":"9","author":"Yin P. Y.","year":"2006","journal-title":"Educ. Technol. Soc."},{"key":"S0218194021500376BIB053","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2007.10.006"},{"issue":"4","key":"S0218194021500376BIB054","first-page":"193","volume":"12","author":"Ho T. F.","year":"2009","journal-title":"Educ. Technol. Soc."},{"key":"S0218194021500376BIB055","doi-asserted-by":"publisher","DOI":"10.1287\/opre.40.1.178"},{"key":"S0218194021500376BIB056","doi-asserted-by":"publisher","DOI":"10.1007\/BF02294509"},{"key":"S0218194021500376BIB057","doi-asserted-by":"publisher","DOI":"10.1177\/014662168801200210"},{"key":"S0218194021500376BIB058","doi-asserted-by":"publisher","DOI":"10.1037\/13240-000"},{"key":"S0218194021500376BIB059","volume-title":"Network Flows: Theory, Algorithms, and Applications","author":"Ahuja R. K.","year":"1993"},{"key":"S0218194021500376BIB060","volume-title":"Proc. Annu. Meeting of the National Council on Measurement in Education","author":"Ackerman T. A.","year":"1989"},{"key":"S0218194021500376BIB061","doi-asserted-by":"publisher","DOI":"10.5937\/telfor1502108I"},{"issue":"6","key":"S0218194021500376BIB062","first-page":"15","volume":"2008","author":"Nakanishi H.","year":"2008","journal-title":"IPSJ SIG Tech. Rep."},{"key":"S0218194021500376BIB063","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-014-0452-4"},{"key":"S0218194021500376BIB064","doi-asserted-by":"publisher","DOI":"10.1177\/0013164412443688"},{"key":"S0218194021500376BIB065","doi-asserted-by":"publisher","DOI":"10.1145\/937503.937505"},{"key":"S0218194021500376BIB066","doi-asserted-by":"publisher","DOI":"10.1016\/0305-0548(86)90048-1"},{"key":"S0218194021500376BIB067","doi-asserted-by":"publisher","DOI":"10.1007\/BF01588971"},{"key":"S0218194021500376BIB068","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194016500327"},{"issue":"5","key":"S0218194021500376BIB069","first-page":"519","volume":"24","author":"Khachaturyan A.","year":"1979","journal-title":"Sov. Phys. Crystallogr."},{"key":"S0218194021500376BIB070","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1995.488968"},{"key":"S0218194021500376BIB071","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-017-9605-z"},{"key":"S0218194021500376BIB073","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2018.2836388"},{"key":"S0218194021500376BIB074","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2019.106040"},{"key":"S0218194021500376BIB075","doi-asserted-by":"publisher","DOI":"10.1016\/0305-0483(83)90088-9"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194021500376","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,17]],"date-time":"2021-09-17T08:33:01Z","timestamp":1631867581000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218194021500376"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8]]},"references-count":71,"journal-issue":{"issue":"08","published-print":{"date-parts":[[2021,8]]}},"alternative-id":["10.1142\/S0218194021500376"],"URL":"https:\/\/doi.org\/10.1142\/s0218194021500376","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"value":"0218-1940","type":"print"},{"value":"1793-6403","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8]]}}}