微信服务号

微信订阅号

2025年4月1日 21:03 星期二
首页 > 过刊浏览>2008年第19卷第2期 >224-236
PDF HTML阅读 XML下载 导出引用 引用提醒
基于属性相关度的Web数据库大小估算方法
作者:
基金项目:

Supported by the National Natural Science Foundation of China under Grant No.60573091 (国家自然科学基金); the National High-Tech Research and Development Plan of China under Grant No.2007AA01Z155 (国家高技术研究发展计划(863)); the Program for New Century Excellent Talents in University of China (新世纪优秀人才支持计划); the Beijing Natural Science Foundation of China under Grant No.4073035 (北京市自然科学基金)


An Attributes Correlation Based Approach for Estimating Size of Web Databases
Author:
  • 摘要
    • | |
  • 访问统计
    • |
  • 参考文献 [14]
    • |
  • 相似文献 [20]
    • |
  • 引证文献
    • | |
  • 文章评论
    摘要:

    提出了一种基于词频统计的方法以估算Web数据库的规模.通过分析Web数据库查询接口中属性之间的相关度来获取某个属性上的一组随机样本;并对该属性分别提交由前k位高频词形成的试探查询以估算Web数据库中记录的总数.通过在几个真实的Web数据库上进行实验验证,说明该方法可以准确地估算出Web数据库的大小.

    Abstract:

    An approach based on the word frequency is proposed in this paper to estimate the size of Web database. It obtains a random sample on a certain attribute by analyzing the attribute correlations among all the textual attributes in the query interface. The size of a Web database can be estimated by submitting probing queries which are generated by top-k frequent words to the query interface of a Web database. The experiments on several real-world databases have proved that this approach is effective and can achieve high accuracy in estimating the size of Web databases.

    参考文献
    [1]Chang KCC,Cho J.Accessing the Web:From search to integration.In:Proc.of 2006 ACM SIGMOD Int'l Conf.on Management of Data (SIGMOD 2006).Chicago:ACM Press,2006.804-805.
    [2]Cope J,Craswell N,Hawking D.Automated discovery of search interfaces on the Web.In:Proc.of the 14th Australasian Database Conf.(ADC 2003).Adelaide:Australian Computer Society Press,2003.181-189.
    [3]Kabra G,Li C,Chang KCC.Query routing:Finding ways in the maze of the deep Web.In:Proc.of the Int'l Workshop on Challenges in Web Information Retrieval and Integration (WIRI 2005).Tokyo:IEEE Computer Society Press,2005.64-73.
    [4]He H,Meng W,Yu CT,Wu Z.WISE-Integrator:An automatic integrator of Web search interfaces for e-commerce.In:Proc.of the 29th Int'l Conf.on Very Large Data Bases (VLDB 2003).Berlin:ACM Press,2003.357-368.
    [5]Wu W,Doan A,Yu CT.WebIQ:Learning from the Web to match deep-Web query interfaces.In:Proc.of the 22nd Int'l Conf.on Data Engineering (ICDE 2006).Atlanta:IEEE Computer Society Press,2006.44.
    [6]Zhai Y,Liu B.Web data extraction based on partial tree alignment.In:Proc.of the 14th Int'l World Wide Web Conf.(WWW 2005).Chiba:ACM Press,2005.76-85.
    [7]Zhao H,Meng W,Wu Z,Raghavan V,Yu CT.Fully automatic wrapper generation for search engines.In:Proc.of the 14th Int'l World Wide Web Conf.(WWW 2005).Chiba:ACM Press,2005.66-75.
    [8]Raghavan S,Garcia-Molina H.Crawling the hidden Web.In:Proc.of the 27th Int'l Conf.on Very Large Data Bases (VLDB 2001).Rome:ACM Press,2001.129-138.
    [9]Wu P,Wen JR,Liu H,Ma WY.Query selection techniques for efficient crawling of structured Web sources.In:Proc.of the 22nd Int'l Conf.on Data Engineering (ICDE 2006).Atlanta:IEEE Computer Society Press,2006.47-58.
    [10]BrightPlanet.com.The deep Web:Surfacing hidden value.2000.http://brightplanet.com
    [11]Liu KL,Yu CT,Meng W.Discovering the representative of a search engine.In:Proc.of the 11th Int'l Conf.on Information and Knowledge Management (CIKM 2002).McLean:ACM Press,2002.652-654.
    [12]Si L,Callan JP.Relevant document distribution estimation method for resource selection.In:Proc.of the 26th ACM Int'l Conf.on Research and Development in Information Retrieval (SIGIR2003).Toronto:ACM Press,2003.298-305.
    [13]Karnatapu S,Ramachandran K,Wu Z.Estimating size of search engines in an uncooperative environment.In:Proc.of the 2nd Int'l Workshop on Web-Based Support Systems 2004 (WSS 2004).Beijing:IEEE Computer Society Press,2004.81-87.
    [14]Shokouhi M,Zobel J,Scholer F,Tahaghoghi SMM.Capturing collection size for distributed non-cooperative retrieval.In:Proc.of the 29th ACM Int'l Conf.on Research and Development in Information Retrieval (SIGIR 2006).Seattle:ACM Press,2006.316-323.
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

凌妍妍,孟小峰,刘 伟.基于属性相关度的Web数据库大小估算方法.软件学报,2008,19(2):224-236

复制
分享
文章指标
  • 点击次数:7803
  • 下载次数: 7602
  • HTML阅读次数: 0
  • 引用次数: 0
历史
  • 收稿日期:2007-09-03
  • 最后修改日期:2007-10-19
文章二维码
友情链接:中国科学院软件研究所中国计算机学会中国科学院国家自然科学基金委员会CCF数字图书馆Int'l J of Softw Info计算机系统应用
您是第19765941位访问者
版权所有：中国科学院软件研究所 京ICP备05046678号-3
地址：北京市海淀区中关村南四街4号,邮政编码：100190
电话：010-62562563 传真：010-62562533 Email：jos@iscas.ac.cn
技术支持：北京勤云科技发展有限公司

京公网安备 11040202500063号