Challenges in Information Retrieval and Language Modeling

J. Allen, J. Aslam, N. Belkin, C. Buckley, J. Callan, W.B. Croft, S. Dumais, N. Fuhr, D. Harman, D.J. Harper, Djoerd Hiemstra, T. Hofmann, E. Hovey, W. Kraaij, J. Lafferty, V. Lavrenko, D. Lewis, L. Liddy, R. Manmatha, A. McCallum & 16 others J. Ponte, J. Prager, D. Radev, P. Resnik, S.E. Robertson, R. Rosenfeld, S. Roukos, M. Sanderson, R. Schwartz, A. Singhal, A. Smeaton, H. Turtle, E.M Voorhees, R. Weischedel, J. Xu, B.C. Zhai

Abstract

Information retrieval (IR) research has reached a point where it is appropriate to assess progress and to define a research agenda for the next five to ten years. This report summarizes a discussion of IR research challenges that took place at a recent workshop. The attendees of the workshop considered information retrieval research in a range of areas chosen to give broad coverage of topic areas that engage information retrieval researchers. Those areas are retrieval models, cross-lingual retrieval, Web search, user modeling, filtering, topic detection and tracking, classification, summarization, question answering, metasearch, distributed retrieval, multimedia retrieval, information extraction, as well as testbed requirements for future work. The potential use of language modeling techniques in these areas was also discussed. The workshop identified major challenges within each of those areas. The following are recurring themes that ran throughout: • User and context sensitive retrieval • Multi-lingual and multi-media issues • Better target tasks • Improved objective evaluations • Substantially more labeled data • Greater variety of data sources • Improved formal models Contextual retrieval and global information access were identified as particularly important long-term challenges.
Original languageUndefined
Article number10.1145/945546.945549
Pages (from-to)31-47
Number of pages17
JournalSIGIR forum
Volume37
Issue number1
DOIs
StatePublished - 2003

Fingerprint

Information retrieval
Testbeds

Keywords

  • DB-IR: INFORMATION RETRIEVAL
  • IR-66226
  • EWI-6250

Cite this

Allen, J., Aslam, J., Belkin, N., Buckley, C., Callan, J., Croft, W. B., ... Zhai, B. C. (2003). Challenges in Information Retrieval and Language Modeling. SIGIR forum, 37(1), 31-47. [10.1145/945546.945549]. DOI: 10.1145/945546.945549

Allen, J.; Aslam, J.; Belkin, N.; Buckley, C.; Callan, J.; Croft, W.B.; Dumais, S.; Fuhr, N.; Harman, D.; Harper, D.J.; Hiemstra, Djoerd; Hofmann, T.; Hovey, E.; Kraaij, W.; Lafferty, J.; Lavrenko, V.; Lewis, D.; Liddy, L.; Manmatha, R.; McCallum, A.; Ponte, J.; Prager, J.; Radev, D.; Resnik, P.; Robertson, S.E.; Rosenfeld, R.; Roukos, S.; Sanderson, M.; Schwartz, R.; Singhal, A.; Smeaton, A.; Turtle, H.; Voorhees, E.M; Weischedel, R.; Xu, J.; Zhai, B.C. / Challenges in Information Retrieval and Language Modeling.

In: SIGIR forum, Vol. 37, No. 1, 10.1145/945546.945549, 2003, p. 31-47.

Research output: Scientific › Article

@article{026366b9eae14e60a813ec4615deb760,
title = "Challenges in Information Retrieval and Language Modeling",
abstract = "Information retrieval (IR) research has reached a point where it is appropriate to assess progress and to define a research agenda for the next five to ten years. This report summarizes a discussion of IR research challenges that took place at a recent workshop. The attendees of the workshop considered information retrieval research in a range of areas chosen to give broad coverage of topic areas that engage information retrieval researchers. Those areas are retrieval models, cross-lingual retrieval, Web search, user modeling, filtering, topic detection and tracking, classification, summarization, question answering, metasearch, distributed retrieval, multimedia retrieval, information extraction, as well as testbed requirements for future work. The potential use of language modeling techniques in these areas was also discussed. The workshop identified major challenges within each of those areas. The following are recurring themes that ran throughout: • User and context sensitive retrieval • Multi-lingual and multi-media issues • Better target tasks • Improved objective evaluations • Substantially more labeled data • Greater variety of data sources • Improved formal models Contextual retrieval and global information access were identified as particularly important long-term challenges.",
keywords = "DB-IR: INFORMATION RETRIEVAL, IR-66226, EWI-6250",
author = "J. Allen and J. Aslam and N. Belkin and C. Buckley and J. Callan and W.B. Croft and S. Dumais and N. Fuhr and D. Harman and D.J. Harper and Djoerd Hiemstra and T. Hofmann and E. Hovey and W. Kraaij and J. Lafferty and V. Lavrenko and D. Lewis and L. Liddy and R. Manmatha and A. McCallum and J. Ponte and J. Prager and D. Radev and P. Resnik and S.E. Robertson and R. Rosenfeld and S. Roukos and M. Sanderson and R. Schwartz and A. Singhal and A. Smeaton and H. Turtle and E.M Voorhees and R. Weischedel and J. Xu and B.C. Zhai",
note = "Imported from EWI/DB PMS [db-utwente:arti:0000003573], http://www.sigir.org/forum/S2003-TOC.html",
year = "2003",
doi = "10.1145/945546.945549",
volume = "37",
pages = "31--47",
journal = "SIGIR forum",
issn = "0163-5840",
publisher = "Association for Computing Machinery (ACM)",
number = "1",

}

Allen, J, Aslam, J, Belkin, N, Buckley, C, Callan, J, Croft, WB, Dumais, S, Fuhr, N, Harman, D, Harper, DJ, Hiemstra, D, Hofmann, T, Hovey, E, Kraaij, W, Lafferty, J, Lavrenko, V, Lewis, D, Liddy, L, Manmatha, R, McCallum, A, Ponte, J, Prager, J, Radev, D, Resnik, P, Robertson, SE, Rosenfeld, R, Roukos, S, Sanderson, M, Schwartz, R, Singhal, A, Smeaton, A, Turtle, H, Voorhees, EM, Weischedel, R, Xu, J & Zhai, BC 2003, 'Challenges in Information Retrieval and Language Modeling' SIGIR forum, vol 37, no. 1, 10.1145/945546.945549, pp. 31-47. DOI: 10.1145/945546.945549

Challenges in Information Retrieval and Language Modeling. / Allen, J.; Aslam, J.; Belkin, N.; Buckley, C.; Callan, J.; Croft, W.B.; Dumais, S.; Fuhr, N.; Harman, D.; Harper, D.J.; Hiemstra, Djoerd; Hofmann, T.; Hovey, E.; Kraaij, W.; Lafferty, J.; Lavrenko, V.; Lewis, D.; Liddy, L.; Manmatha, R.; McCallum, A.; Ponte, J.; Prager, J.; Radev, D.; Resnik, P.; Robertson, S.E.; Rosenfeld, R.; Roukos, S.; Sanderson, M.; Schwartz, R.; Singhal, A.; Smeaton, A.; Turtle, H.; Voorhees, E.M; Weischedel, R.; Xu, J.; Zhai, B.C.

In: SIGIR forum, Vol. 37, No. 1, 10.1145/945546.945549, 2003, p. 31-47.

Research output: Scientific › Article

TY - JOUR

T1 - Challenges in Information Retrieval and Language Modeling

AU - Allen,J.

AU - Aslam,J.

AU - Belkin,N.

AU - Buckley,C.

AU - Callan,J.

AU - Croft,W.B.

AU - Dumais,S.

AU - Fuhr,N.

AU - Harman,D.

AU - Harper,D.J.

AU - Hiemstra,Djoerd

AU - Hofmann,T.

AU - Hovey,E.

AU - Kraaij,W.

AU - Lafferty,J.

AU - Lavrenko,V.

AU - Lewis,D.

AU - Liddy,L.

AU - Manmatha,R.

AU - McCallum,A.

AU - Ponte,J.

AU - Prager,J.

AU - Radev,D.

AU - Resnik,P.

AU - Robertson,S.E.

AU - Rosenfeld,R.

AU - Roukos,S.

AU - Sanderson,M.

AU - Schwartz,R.

AU - Singhal,A.

AU - Smeaton,A.

AU - Turtle,H.

AU - Voorhees,E.M

AU - Weischedel,R.

AU - Xu,J.

AU - Zhai,B.C.

N1 - Imported from EWI/DB PMS [db-utwente:arti:0000003573], http://www.sigir.org/forum/S2003-TOC.html

PY - 2003

Y1 - 2003

N2 - Information retrieval (IR) research has reached a point where it is appropriate to assess progress and to define a research agenda for the next five to ten years. This report summarizes a discussion of IR research challenges that took place at a recent workshop. The attendees of the workshop considered information retrieval research in a range of areas chosen to give broad coverage of topic areas that engage information retrieval researchers. Those areas are retrieval models, cross-lingual retrieval, Web search, user modeling, filtering, topic detection and tracking, classification, summarization, question answering, metasearch, distributed retrieval, multimedia retrieval, information extraction, as well as testbed requirements for future work. The potential use of language modeling techniques in these areas was also discussed. The workshop identified major challenges within each of those areas. The following are recurring themes that ran throughout: • User and context sensitive retrieval • Multi-lingual and multi-media issues • Better target tasks • Improved objective evaluations • Substantially more labeled data • Greater variety of data sources • Improved formal models Contextual retrieval and global information access were identified as particularly important long-term challenges.

AB - Information retrieval (IR) research has reached a point where it is appropriate to assess progress and to define a research agenda for the next five to ten years. This report summarizes a discussion of IR research challenges that took place at a recent workshop. The attendees of the workshop considered information retrieval research in a range of areas chosen to give broad coverage of topic areas that engage information retrieval researchers. Those areas are retrieval models, cross-lingual retrieval, Web search, user modeling, filtering, topic detection and tracking, classification, summarization, question answering, metasearch, distributed retrieval, multimedia retrieval, information extraction, as well as testbed requirements for future work. The potential use of language modeling techniques in these areas was also discussed. The workshop identified major challenges within each of those areas. The following are recurring themes that ran throughout: • User and context sensitive retrieval • Multi-lingual and multi-media issues • Better target tasks • Improved objective evaluations • Substantially more labeled data • Greater variety of data sources • Improved formal models Contextual retrieval and global information access were identified as particularly important long-term challenges.

KW - DB-IR: INFORMATION RETRIEVAL

KW - IR-66226

KW - EWI-6250

U2 - 10.1145/945546.945549

DO - 10.1145/945546.945549

M3 - Article

VL - 37

SP - 31

EP - 47

JO - SIGIR forum

T2 - SIGIR forum

JF - SIGIR forum

SN - 0163-5840

IS - 1

M1 - 10.1145/945546.945549

ER -

Allen J, Aslam J, Belkin N, Buckley C, Callan J, Croft WB et al. Challenges in Information Retrieval and Language Modeling. SIGIR forum. 2003;37(1):31-47. 10.1145/945546.945549. Available from, DOI: 10.1145/945546.945549

Access to Document