paython爬取github登录页面token信息并登录github
paython爬取github登录页面token信息并登录github。
2.用到的库：
手动登录查看需要的参数，观察一次登录发送的请求
登录过程如下：
发现除了一个token是动态的，其他的都是输入或是固定的。
页面查找token：
参数如下：
'login':'。。。',
'password':'。。。',
'authenticity_token':token,
'commit':'Sign in',
'utf8': "✓"}
用正则在登录页面爬取登录用的token,并赋值到参数里
接着用会话对象去发送带有参数的数据到url
# -*- coding:utf-8 -*-
import requests
'''''
用到的库：
手动登录查看需要的参数，观察一次登录发送的请求
发现除了一个token是动态的，其他的都是输入或是固定的。参数如下：
'login':'。。。',
'password':'。。。',
'authenticity_token':token,
'commit':'Sign in',
'utf8': "✓"}
用正则在登录页面爬取登录用的token,并赋值到参数里
接着用会话对象去发送带有参数的数据到url
'''
s = requests.Session()#获取会话对象，用于登录时的cookie和session
header = {'Host': &#',
'User-Agent': 'Mozilla/5.0 (M Intel Mac OS X 10.11; rv:47.0) Gecko/ Firefox/47.0',
'Accept': 'text/html,application/xhtml+xml,application/q=0.9,*/*;q=0.8',
'Accept-Language': 'en-US,q=0.5',
'Accept-Encoding': 'gzip, deflate, br',
'Referer': '',
'Connection': 'keep-alive'}
indexUrl = '/'#首页地址
loginUrl = '/login'#登录页面
sessionUrl = '/session'#登录页面把表单提交到这个url，然后重定向到首页，把数据提交到这个Url之后可以获取到cookie,用于登录
##&&& payload = {'key1': 'value1', 'key2': 'value2'}
##&&& r = requests.get("http://httpbin.org/get", params=payload)
tokenRule = '&input name="authenticity_token" type="hidden" value="(.*?)"'#登录参数里面有一个token参数，是加载到页面中并且是动态的，需要爬出来
loginHtml = s.get(loginUrl,headers=header)#得到登录页面
tokenPattern = re.compile(tokenRule,re.S)
arraryTolen = re.findall(tokenPattern,loginHtml.text)#得到动态的token,这里返回的事数组，取第一个
#print(loginHtml.text)
token = arraryTolen[0]
print("the token is: ",token)
loginParams = {'login':'*****',
'password':'******',
'authenticity_token':token,
'commit':'Sign in',
'utf8': "✓"}#配置登录参数
sessionHtml = s.post(sessionUrl,data=loginParams)#得到登录后的页面，其实被定位到了首页
'''''
输出是否登录成功，如果不成功返回状态码和原因，以及详细的错误页面
'''
print("the session rsult is: ",sessionHtml.status_code)
print("the reason is: ",sessionHtml.reason)
print("the detail is: ",sessionHtml.text)
indexhtml = s.get('/HanlaoTwo/StacknotOverFlow',headers=header)#可以继续用这个会话对象去访问需要登录的页面
print(indexhtml.text)Latest release - 2.7.0
Jython: Python for the Java Platform
The Jython Project
Latest News
Jython 2.7.0 Final Released (May 2015)
Please see the
file for detailed release notes.
Read more on .
Jython 2.7 Release Candidate 3 Released (April 2015)
Please see the
file for detailed release notes.
Read more on .
Jython 2.7 PyCon 2015 Talk (April 2015)
Jim Baker gave a
at PyCon 2015 in Montreal
about how we got to Jython 2.7 and what's coming next.
Jython 2.7 Release Candidate 2 Released (April 2015)
Please see the
file for detailed release notes.
Read more on .
Jython 2.7 Release Candidate 1 Released (March 2015)
Read more on .
Jython 2.7 Beta 4 Released (February 2015)
Please see the
file for detailed release notes.
Read more on .
Jython 2.7 Beta 3 Released (August 2014)
Please see the
file for detailed release notes.
Read more on .
Jython 2.7 Beta 2 Released (May 2013)
Jython 2.7b2 brings us up to language level compatibility with the 2.7 version
of CPython. We have focused largely on CPython compatibility, and so this
release of Jython can run more pure Python apps then any previous release.
Please see the NEWS file for detailed release notes. This is primarily a bugfix
release, with numerous improvements, including much improvement on Windows
Read more on
PyDev 3.4.1 Available (May 2013)
Please visit the
for more information.
PyDev 3.0 Released (November 2013)
From now on, PyDev requires Eclipse 3.7 or 4.3 onwards and Java 7! For older versions, keep using PyDev 2.x.
Interpreter is now kept up to date with changes to the interpreter, so, pip-installing packages will automatically update internal caches without requiring a manual step.
Fixed issue connecting to shell for code-completion (which could halt the IDE).
Please visit the
for more information.
JyNI 2.7-alpha 2 Released (October 2013)
JyNI is a compatibility layer with the goal to enable Jython to use native CPython extensions like NumPy or SciPy. This way we aim to enable scientific Python code to run on Jython. Since Java is rather present in industry, while Python is more present in science, JyNI is an important step to lower the cost of using scientific code in industrial environments.
Our philosophy is to integrate JyNI with Jython and CPython extensions as seamless as possible. So JyNI aims to work without any recompilation of Jython or the desired CPython extensions. It neither requires a customized Jython version, nor customized versions of the CPython extensions (of course your JyNI version must meet the platform your CPython extension was build for). Simply put JyNI.jar on the classpath (along with its native libraries) and Jython should ?magically? be able to load native extensions, as far as the needed Python C-API is already implemented by JyNI.
Read More at
Jython 2.5.4rc 1 Has Been Released (February 10, 2013)
This release fixes numerous bugs since the 2.5.3 release of Jython. Some highlights include:
-The file upload fix for Tomcat and Jetty has been changed
-Some NullPointerExceptions where fixed.
For more information, see the .
Jython 2.7beta 1 Has Been Released (February 10, 2013)
The Jython development team is proud to announce the 2.7beta 1 release!
Jython 2.7b1 brings us up to language level compatibility with the 2.7 version
of CPython. We have focused largely on CPython compatibility, and so this
release of Jython can run more pure Python apps then any previous release.
Some notable new features
in this release are: a bytearray implementation, a buffer api, memoryview, and a
bz2 module.
Please see the
for detailed release notes.
Jython 2.5.3 Final Has Been Released (August 13, 2012)
The Jython development team is proud to announce the final 2.5.3 release!
For a complete listing of changes, please visit the .
Latest Blogs and Interesting Stuff
Jython 101 - A Refreshing Look at a Mature Alternative - Part 2 (May/June 2013)
Article covering the integration of Jython and Java - Part 2 of 2
Jython 101 - A Refreshing Look at a Mature Alternative (March/April 2013)
Article on Jython that was published in Java Magazine - Part 1 of 2
Customizing Jython ProxyMaker (Wednesday, January 9, 2013)
I just got a set of patches under &Customizable ProxyMaker& umbrella committed into Jython 2.7. In this post i will try to explain a bit of what Jython's ProxyMaker is and what benefits the ability to customize/override brings for interop with Java.
Visit Post:
Jython Dev Notes Part 2:
Adding a New Builtin Type (Monday February 13, 2012)
Releases of Python (and so releases of Jython) sometimes add new built-in types. In 2.6, a new such buitin is the &bytes& type. In the 2.x series, &bytes& is just a synonym for &str&. In 3.x &bytes& is the name used for 8 bit strings while &str& is a unicode string (and so the &unicode& type disappears in 3.x). This will make it a great example for adding a builtin since there is no added functionality to obscure the basics.
Jython Dev Notes Part 1:
The Jython Exposer (Monday January 2, 2012)
One of my new years resolutions is to make Jython more friendly to new developers. One way to do that is to write up some notes on bits of Jython that are particularly mysterious to newcomers. I've boldly titled this post &Jython dev notes part I& to push myself to create more than one of these :)
The Definitive Guide to Jython is Published (February 6, 2010)
, written by the official Jython team leads, covers the latest Jython 2.5 (or 2.5.x) from the basics to the advanced features. This book begins with a brief introduction to the language and then journeys through Jythons different features and uses.
is organized for beginners as well as advanced users of the language. The book provides a general overview of the Jython language itself, but it also includes intermediate and advanced topics regarding database, web, and GUI and integration, concurrency, and parallelism, to name a few.
This book is available in open-source format at .
Websphere Application Server Administration Using Jython (January 30, 2010)
Utilizing Jython scripting, you can dramatically reduce the effort, resources, and expense associated with managing WebSphere Application Server. WebSphere Application Server Administration Using Jython will show you how.
Read more about it at
Project Sikuli Released (January 28, 2010)
Sikuli is a visual technology to search and automate graphical user interfaces (GUI) using images (screenshots). The first release of Sikuli contains Sikuli Script, a visual scripting API for Jython, and Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily. Sikuli Script automates anything you see on the screen without internal API's support. You can programmatically control a web page, a desktop application running on Windows/Linux/Mac OS X, or even an iphone application running in an emulator.
For more information, please visit the
project site.
Jython Doc Set Updated (November 08, 2009)
The Jython
set has been updated to include all modules contained within the Jython standard library.
However, it should be noted that this is still a work in progress since many of these documents have not yet been parsed and tested completely with Jython 2.5.1.
Stay tuned for more updates on the doc set!
Please report all found bugs to the .
Jython 2.5 Documentation
The documentation for Jython 2.5 is being developed on our .
Please help
Jython by adding content and updating our wiki. As the content matures for 2.5
it will be pulled back into this website.
You may also wish to check the
mailing list archives as many questions and answers can be found there.工具显示源文件修订记录反向链接最近更改媒体管理器网站地图登录&
京东优惠券
python-network-application:urlencode
python urlencode 编码
urlencode 调用方法
urlencode的参数必须是Dictionary
d= {'par1':'a','par2':'b',}
print urllib.urlencode(m)
#par2=b&par1=a
urlencode 编码
函数urlencode不会改变传入参数的原始编码，也就是说需要在调用之前将post或get参数的编码调整好。Python编码转换可以参考
问题：现在模拟请求Google和baidu，由于baidu使用的是gb2312编码,google使用的是utf8编码，两个站点提交到URL中的中文参数的urlencode值是不一样，下面以“帝国”为例:
python文件的
# coding: UTF-8
执行urllib.urlencode(“帝国”)得到的结果是：%E5%B8%9D%E5%9B%BD, 此结果说明默认使用 urlencode得到的结果是utf8编码的“帝国”。
现在想得到gb2312编码的“帝国”怎么办呢？
st = u'帝国'
st = st.encode('gb2312')
m = {'par':st,}
s = urllib.urlencode(m)
#结果为par=%B5%DB%B9%FA
django中urlencode类似，方法如下：
from django.utils.http import urlquote
a = urlquote('帝国')
得到汉字的GBK编码
其实可以用urllib的quote函数对URL中的中文进行转换，将中文转换成GBK的编码，得到的编码是符合URI标准的URL。
&&& import urllib
&&& a = &帝国&
'\xb5\xdb\xb9\xfa'
&&& urllib.quote(a)
'%B5%DB%B9%FA'