当前位置：首页 > 资讯 > 技术文档

python使用心得之获得github代码库列表

时间：2020-05-14 09:26 编辑：来源：阅读：
扫一扫，手机访问

摘要：python使用心得之获得github代码库列表

1.背景项目需求，要求获得github的repo的api，以便可以提取repo的数据进行分析。研究了一天，终于解决了这个问题，虽然效率还是比较低下。因为github的那个显示repo的api，列出了每个repo的详细信息，而且是json格式的。现在貌似还没有找到可以分析多个json格式数据的方法，所以用的是比较蠢得splite加re的方法。如果大家有更好的方法，不发留言讨论！ 2.代码

import re
import os

def GetUrl(num):
 str = os.popen("curl -G https://api.github.com/repositories?since=%d"%(num)).read()
 pattern = '"url"'
 pattern1='repos'
 urls=str.split(',\n')  
 for i in urls:
  if pattern in i and pattern1 in i:   
#  text1=i.splite(':')
  text=re.compile('"(.*?)"').findall(i)[1]
  print text
if __name__=='__main__':
 GetUrl(1000)

其中num的值指的是页面的id，我们可以做一个循环，不断增大num的值，就可以无限提取repo。因为github的api对于流量是有限制的，所以这么做是一个可行的方法。效果如下（提取下来的repo的api地址）： [url=https://api.github.com/repos/wycats/merb-core]https://api.github.com/repos/wycats/merb-core[/url] [url=https://api.github.com/repos/rubinius/rubinius]https://api.github.com/repos/rubinius/rubinius[/url] [url=https://api.github.com/repos/mojombo/god]https://api.github.com/repos/mojombo/god[/url] [url=https://api.github.com/repos/vanpelt/jsawesome]https://api.github.com/repos/vanpelt/jsawesome[/url] [url=https://api.github.com/repos/wycats/jspec]https://api.github.com/repos/wycats/jspec[/url] [url=https://api.github.com/repos/defunkt/exception_logger]https://api.github.com/repos/defunkt/exception_logger[/url] [url=https://api.github.com/repos/defunkt/ambition]https://api.github.com/repos/defunkt/ambition[/url] [url=https://api.github.com/repos/technoweenie/restful-authentication]https://api.github.com/repos/technoweenie/restful-authentication[/url] [url=https://api.github.com/repos/technoweenie/attachment_fu]https://api.github.com/repos/technoweenie/attachment_fu[/url] [url=https://api.github.com/repos/topfunky/bong]https://api.github.com/repos/topfunky/bong[/url] [url=https://api.github.com/repos/Caged/microsis]https://api.github.com/repos/Caged/microsis[/url] [url=https://api.github.com/repos/anotherjesse/s3]https://api.github.com/repos/anotherjesse/s3[/url] [url=https://api.github.com/repos/anotherjesse/taboo]https://api.github.com/repos/anotherjesse/taboo[/url] [url=https://api.github.com/repos/anotherjesse/foxtracs]https://api.github.com/repos/anotherjesse/foxtracs[/url] [url=https://api.github.com/repos/anotherjesse/fotomatic]https://api.github.com/repos/anotherjesse/fotomatic[/url] [url=https://api.github.com/repos/mojombo/glowstick]https://api.github.com/repos/mojombo/glowstick[/url] [url=https://api.github.com/repos/defunkt/starling]https://api.github.com/repos/defunkt/starling[/url] [url=https://api.github.com/repos/wycats/merb-more]https://api.github.com/repos/wycats/merb-more[/url] [url=https://api.github.com/repos/macournoyer/thin]https://api.github.com/repos/macournoyer/thin[/url] [url=https://api.github.com/repos/jamesgolick/resource_controller]https://api.github.com/repos/jamesgolick/resource_controller[/url] [url=https://api.github.com/repos/jamesgolick/markaby]https://api.github.com/repos/jamesgolick/markaby[/url] [url=https://api.github.com/repos/jamesgolick/enum_field]https://api.github.com/repos/jamesgolick/enum_field[/url] [url=https://api.github.com/repos/defunkt/subtlety]https://api.github.com/repos/defunkt/subtlety[/url] [url=https://api.github.com/repos/defunkt/zippy]https://api.github.com/repos/defunkt/zippy[/url] [url=https://api.github.com/repos/defunkt/cache_fu]https://api.github.com/repos/defunkt/cache_fu[/url] [url=https://api.github.com/repos/KirinDave/phosphor]https://api.github.com/repos/KirinDave/phosphor[/url]

全部评论(0)

上一篇：php 文件上传代码(限制jpg文件)
下一篇：PHP令牌 Token改进版

资讯排行榜
更多>>