LIS 2600 Unit11 web search and OAI protocal Reading notes

1) David Hawking , Web Search Engines: Part 1 and Part 2 IEEE Computer, June 2006.
http://www.computing.dcu.ie/~gjones/Teaching/CA437/01642621.pdf
http://david-hawking.net/pubs/hawking_howthingswork2.pdf
2) Shreeves, S. L., Habing, T. O., Hagedorn, K., & Young, J. A. (2005). Current developments and future trends for the OAI protocol for metadata harvesting. Library Trends, 53(4), 576-589.
http://quod.lib.umich.edu/cgi/t/text/text-idx?c=jep;view=text;rgn=main;idno=3336451.0007.104
3) MICHAEL K. BERGMAN, “The Deep Web: Surfacing Hidden Value” http://www.press.umich.edu/jep/07-01/bergman.html

1, Web Search Engines: Part1

This essay talks several aspects and changes in the web search engines such as the crawling problem and spam problem. I found this is really interesting. Web engines have to perfectly deal with these problems to meet patron's needs.


2, Web Search Engines: Part 2

Part 2 reviews the algorithms and data structures required to index 400 terabytes of web pages and deliver high-quality results in response to hundreds of millions of queries each day.
This article is a little harder for me, as I am not familiar with the terminology of information retrieval.

3, Current developments and future trends for the OAI protocol for metadata harvesting

The mission of the Open Archives Initiative, the entity responsible for the protocol, is to " develop and promote interoperability standards that aim to facilitate the efficient dissemination of the content". The protocol is based on common standards like XML. HTTP and Dubline Core.

4， The Deep Web: surfacing hidden value

This article contains several characteristics of deep web and compare the surface web against the deep web.
Directed query technology is the only mean to integrate deep and surface Web information. I am interested in exploring the content of deep web pages, what is the current achievements? How to realized the goal? This is still a problem.

LIS 2600 Unit 10 XML muddiest point

It seems that XML schema is more powerful than XML DTD. SO why we learn DTD. Is there a case that DTD is more useful than XML schema? Can you give some comparisons between DTD and XML schema?

Assignment 6: my website

http://www.pitt.edu/~hey3/

Comments part 1

1, http://issuesininfotech2600.blogspot.com/2009/09/zotero-muddiest-point.html?showComment=1258342369057_AIe9_BEj9L0md-OcYCs4jC7fj3dwLSZ_Q4ypeuI0svyfGMmKFySaixevxDBVE6wxI42krbAy738KBWBi9IE2Kn9lwsyv1zBIOmQAsrod6WHCok8-LVKu7n0iWB6uptWQenkjzP65uKzOcTLgoDq7L1hvaNdp1v_UI_vOaxA_Pj94BqMipZWX6zJSDoFtJZqERTxvymIwCOnj_RwbY-ROwFJikkdDgCobetjo3qgr54O2YSA-1P7VP3c_gbOjhs2tdG_x3j5aHR2n#c8766946446586595858

2,http://issuesininfotech2600.blogspot.com/2009/09/muddiest-point-week-4.html?showComment=1258342745901_AIe9_BEBg1dk3j9kys8RQRg_jtRMwWUM8xn2snM12zTnih_OfHUa5exUJxeOWpGtBxqCe4nADzFoX6Eq0R918VgcVpgJX_VILrX7G4oCv_TktWCPRtCHu374B6NRwzcNBeMT7Z6_jCqoKtBEYC6iWgKVoQIGA99l5I2PFtpy2j3IFQjxUocSBE4FPyCCugfVEPxe_0YoVjpvwR7a_xkEGZI9D0yfPxhLUl9L0d39VsytL4ueQd-1U0G1H6corlrc_x7_di5f4DZn#c1023083923755836252

3,http://lid25lis2600.blogspot.com/2009/09/muddiest-point-1.html?showComment=1258343377373_AIe9_BF7wEQNqgLDc-S-XNXXDImSLwP0LbniSkt7mRQ9G7oNcup9YdUNdhnXYtjs2LyLrRvuEsncQLoQNOGngaXg1NNZfDmUki4QzXShWylLfFSaBBo7SIOZiIyaTd-7gVcRh4bsSlnXKy0fRS7caulrQlxJAY9Hy15H_j0j6LniYKNIhpKpQOQ2hHv-aqTSw_0Xs0xCN1x5xbgjrofnCyOO_fEzsQgU3xshBIgQUAF5N8Z6LJrNbCM#c1351647607728965920

4,http://knivesnmatches.blogspot.com/2009/10/muddiest-point_11.html?showComment=1258343833748_AIe9_BGO-48wuOBgaV-ITGtd7bs6nrpqBJcmnoREiMPiGEdxc_hOrFV08owsmj-n-HgcmCDHh7XEU1CIGFiPuG9iWXmduj6H6BRzoiII-tQuVm8bFQWGqg5nHyCcYbGwVbccyrYEmpm4doGIqK1UWvB30DyrSNRUGDIc4ONJknLZCbx9WyvKlAZCTDxuXY5DnxKp8zckjCsTdpI5vdidiLQIKB319Hwku-WOMbEBl65olmWLY61I0Fc#c829060142898849071

5,http://knivesnmatches.blogspot.com/2009/09/muddiest-point.html?showComment=1258344083572_AIe9_BGoVAi0xcFFQ6rtXFV2aW3a0yp_Iha9idLRxtLxSEN_SMcJ4Sj46BsytEawTUdyr2rAx340rlc0HLy1LSQEBNWWSquUPDVokIruBecYyjt9piWxq_dF-E8q_LiyDA_iMDs4sb-DU-liE7PmZIRxgqqLWnxOkT9ZjJSi_0HNgW92T7thAQs1B80lgRYLkRo65zryyaB8KVCMObJtrC6e6ypN3nlIPF-CRG84vOz58r_ThgSydAw#c3169918875189446587