3 \F@sdZddlZddlZddlZddlZddlZy ddlZWnek rPdZYnXdZddl m Z ddlm Z ddd d d d d dgZ dZGdddeZGdd d eZGdd d eZGdd d eZGdd d eZGdd d eZdZdZddddddddd d!d"d#h Zd$d%d&d'd(d)d*gZd)d*d+Zd,Zejd-d.d/d0d1gZejd2d3d4d5gZd6dZ d7d8Zdld9d:Z dmd;d<Z!dnd=d>Z"erd?d@Z#GdAdBdBZ$GdCdde$Z%erGdDdEdEe$Z&e j'dEe(dFkrddl)Z)e)j*dGdHZ+e+j,dIdJdKdLdMe+j,dNdOdPdQdMe+j,dRdSdoe-dUeefdVe+j,dWdXdYe-dZdVe+j,d[d\d]dd^d_e+j.Z/e/j0Z0e/jse0dpkrteZ0e%e/j1e0d`Z2ne0dqkreZ0e&e/j1e0d`Z2e2j3Z4dae4kre2j5e2j6e/j6\Z7Z8Z9Z:Z;ee-e:e/j?dTZ9e2j@e9e:\Z7ZAxbeAD]Z\ZBZCe eCd%jDdhdTdZEe eCd$ZFe-eCd*ZGe>> from nntplib import NNTP >>> s = NNTP('news') >>> resp, count, first, last, name = s.group('comp.lang.python') >>> print('Group', name, 'has', count, 'articles, range', first, 'to', last) Group comp.lang.python has 51 articles, range 5770 to 5821 >>> resp, subs = s.xhdr('subject', '{0}-{1}'.format(first, last)) >>> resp = s.quit() >>> Here 'resp' is the server response line. Error responses are turned into exceptions. To post an article from a file: >>> f = open(filename, 'rb') # file containing article, including header >>> resp = s.post(f) >>> For descriptions of all methods, read the comments in the code below. Note that all arguments and return values representing article numbers are strings, not numbers, since they are rarely used for calculations. NFT) decode_header)_GLOBAL_DEFAULT_TIMEOUTNNTP NNTPErrorNNTPReplyErrorNNTPTemporaryErrorNNTPPermanentErrorNNTPProtocolError NNTPDataErrorric@seZdZdZddZdS)rz%Base class for all nntplib exceptionsc Gs>tj|f|y|d|_Wntk r8d|_YnXdS)NrzNo response given) Exception__init__response IndexError)selfargsr/usr/lib64/python3.6/nntplib.pyr bs zNNTPError.__init__N)__name__ __module__ __qualname____doc__r rrrrr`sc@seZdZdZdS)rzUnexpected [123]xx replyN)rrrrrrrrrisc@seZdZdZdS)rz 4xx errorsN)rrrrrrrrrmsc@seZdZdZdS)rz 5xx errorsN)rrrrrrrrrqsc@seZdZdZdS)r z"Response does not begin with [1-5]N)rrrrrrrrr usc@seZdZdZdS)r zError in response dataN)rrrrrrrrr yswi3Z100Z101211215Z220Z221Z222Z224Z225Z230Z231Z282subjectfromdatez message-idZ referencesz:bytesz:lines)bytesliness GroupInfogrouplastfirstflag ArticleInfoZnumber message_idrcCsNg}x>t|D]2\}}t|tr6|j|j|p.dq|j|qWdj|S)zvTakes a unicode string representing a munged header value and decodes it as a (possibly non-ASCII) readable value.ascii)_email_decode_header isinstancerappenddecodejoin)Z header_strpartsvencrrrrs  cCsg}xh|D]`}|ddkr<|ddjd\}}}d|}n|jd\}}}|j}tj||}|j|q Wt}t|t|krtd|dt||krtd|S)zParse a list of string representing the response to LIST OVERVIEW.FMT and return a list of header/metadata names. Raises NNTPDataError if the response is not compliant (cf. RFC 3977, section 8.4).r:Nz$LIST OVERVIEW.FMT response too shortz*LIST OVERVIEW.FMT redefines default fields) partitionlower_OVERVIEW_FMT_ALTERNATIVESgetr*_DEFAULT_OVERVIEW_FMTlenr )rfmtlinename_suffixZdefaultsrrr_parse_overview_fmts    r=cCstt}g}x|D]}i}|jd^}}t|}xt|D]\} } | t|krPq:|| } | jd} | |kr| r| d} | r| dt| j| krtd| r| t| dnd} | ||| <q:W|j||fqW|S)zZParse the response to an OVER or XOVER command according to the overview format `fmt`. r0z: Nz?OVER/XOVER response doesn't include names of additional headers) r7r6splitint enumerate startswithr3r r*)rr8Zdata_process_funcZ n_defaultsZoverviewr9ZfieldsZarticle_numbertokensitokenZ field_nameZ is_metadatahrrr_parse_overviews&   rGcCs|dkr |d d}|dd }t|dd}t|dd}t|dd}t|dd }t|d d }t|dd}|dkr|d7}n|dkr|d7}tj||||||S)zParse a pair of (date, time) strings, and return a datetime object. If only the date is given, it is assumed to be date and time concatenated together (e.g. response to the DATE command). NFidiliirMrN)r@datetime)date_strtime_strZhoursZminutesZsecondsyearZmonthZdayrrr_parse_datetimes   rScCsPt|tjsd}n dj|}|j}|r<|d}dj||}n dj||}||fS)aPFormat a date or datetime object as a pair of (date, time) strings in the format required by the NEWNEWS and NEWGROUPS commands. If a date object is passed, the time is assumed to be midnight (00h00). The returned representation depends on the legacy flag: * if legacy is False (the default): date has the YYYYMMDD format and time the HHMMSS format * if legacy is True: date has the YYMMDD format and time the HHMMSS format. RFC 3977 compliant servers should understand both formats; therefore, legacy is only needed when talking to old servers. Z000000z({0.hour:02d}{0.minute:02d}{0.second:02d}rLz{0:02d}{1.month:02d}{1.day:02d}z{0:04d}{1.month:02d}{1.day:02d})r)rOformatrR)ZdtlegacyrQyrPrrr_unparse_datetimes   rWcCs|dkrtj}|j||dS)zWrap a socket in SSL/TLS. Arguments: - sock: Socket to wrap - context: SSL context to use for the encrypted connection Returns: - sock: New, encrypted socket. N)Zserver_hostname)sslZ_create_stdlib_contextZ wrap_socket)sockcontextZhostnamerrr _encrypt_onsr[c@seZdZdZdZdefddZddZdd Zd d Z d d Z ddZ e Z ddZ ddZdhddZddZdiddZddZdjddZdkdd Zd!d"Zd#d$Zd%d&Zdd'd(d)Zdd'd*d+Zdldd'd,d-Zd.d/Zd0d1Zd2d3Zd4d5Zdd'd6d7Zd8d9Z d:d;Z!dmdd?Z#d@dAZ$dndBdCZ%dodd'dDdEZ&dpdd'dFdGZ'dqdd'dHdIZ(dJdKZ)dd'dLdMZ*dd'dNdOZ+dd'dPdQZ,dd'dRdSZ-dTdUZ.dVdWZ/dXdYZ0dZd[Z1d\d]Z2d^d_Z3d`daZ4drdbdcZ5dddeZ6e7rdsdfdgZ8dS)t _NNTPBasezutf-8surrogateescapeNcCsj||_||_d|_|j|_d|_|jd|_|rZd|jkrZ|j|jsZd|_|jd|_ d|_ dS)aSInitialize an instance. Arguments: - file: file-like object (open for read/write in binary mode) - host: hostname of the server - readermode: if true, send 'mode reader' command after connecting. - timeout: timeout (in seconds) used for socket connections readermode is sometimes necessary if you are connecting to an NNTP server on the local machine and intend to call reader-specific commands, such as `group'. If you get unexpected NNTPPermanentErrors, you might need to set readermode. rNFREADER) hostfile debugging_getrespwelcome_capsgetcapabilitiesreadermode_afterauth_setreadermodetls_on authenticated)rr`r_ readermodetimeoutrrrr 8s  z_NNTPBase.__init__cCs|S)Nr)rrrr __enter__gsz_NNTPBase.__enter__csRfdd}|rNz*y jWnttfk r8YnXWd|rLjXdS)Ncs tdS)Nr`)hasattrr)rrrksz$_NNTPBase.__exit__..)quitOSErrorEOFError_close)rrZ is_connectedr)rr__exit__js   z_NNTPBase.__exit__cCs|jrtdt|j|jS)zGet the welcome message from the server (this is read and squirreled away by __init__()). If the response code is 200, posting is allowed; if it 201, posting is not allowed.z *welcome*)raprintreprrc)rrrr getwelcomeusz_NNTPBase.getwelcomec Cs|jdkrd|_d|_y|j\}}Wnttfk rDi|_Ynsz,_NNTPBase._longcmdstring..)rr)rr9r`r}listr)rr_longcmdstrings  z_NNTPBase._longcmdstringcCsby|jStk rYnXy|jd\}}Wn tk rNtdd}Yn Xt|}||_|S)zqInternal: get the overview format. Queries the server if not already done, else returns the cached value.zLIST OVERVIEW.FMTN)Z_cachedoverviewfmtAttributeErrorrrr6r=)rr}rr8rrr_getoverviewfmtsz_NNTPBase._getoverviewfmtcCsdd|DS)NcSsg|]}t|jqSr)rr?)rr9rrrr$sz(_NNTPBase._grouplist..r)rrrrr _grouplist"sz_NNTPBase._grouplistcCs<i}|jd\}}x |D]}|j^}}|||<qW||fS)a!Process a CAPABILITIES command. Not supported by all servers. Return: - resp: server response if successful - caps: a dictionary mapping capability names to lists of tokens (for example {'VERSION': ['2'], 'OVER': [], LIST: ['ACTIVE', 'HEADERS'] }) Z CAPABILITIES)rr?)rr~r}rr9r:rCrrrrz&s    z_NNTPBase.capabilities)r`cCsbt|tjtjfs$tdj|jjt||jdk\}}dj||}|j ||\}}||j |fS)zProcess a NEWGROUPS command. Arguments: - date: a date or datetime object Return: - resp: server response if successful - list: list of newsgroup names zAthe date parameter must be a date or datetime object, not '{:40}'rIzNEWGROUPS {0} {1}) r)rOr TypeErrorrT __class__rrWryrr)rrr`rPrQcmdr}rrrr newgroups4s  z_NNTPBase.newgroupscCsRt|tjtjfs$tdj|jjt||jdk\}}dj|||}|j ||S)zProcess a NEWNEWS command. Arguments: - group: group name or '*' - date: a date or datetime object Return: - resp: server response if successful - list: list of message ids zAthe date parameter must be a date or datetime object, not '{:40}'rIzNEWNEWS {0} {1} {2}) r)rOrrrTrrrWryr)rr rr`rPrQrrrrnewnewsDs z_NNTPBase.newnewscCs4|dk rd|}nd}|j||\}}||j|fS)a@Process a LIST or LIST ACTIVE command. Arguments: - group_pattern: a pattern indicating which groups to query - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of (group, last, first, flag) (strings) Nz LIST ACTIVE ZLIST)rr)r group_patternr`commandr}rrrrrTs  z_NNTPBase.listc Cstjd}|jd|\}}|jds8|jd|\}}i}x>|D]6}|j|j}|rB|jdd\} } |sp| S| || <qBW|r||fSdSdS)Nz^(?P[^ ]+)[ ]+(.*)$zLIST NEWSGROUPS rzXGTITLE r1rIr')recompilerrBsearchstripr ) rrZ return_allline_patr}rgroupsraw_linematchr:Zdescrrr_getdescriptionscs    z_NNTPBase._getdescriptionscCs |j|dS)aGet a description for a single group. If more than one group matches ('group' is a pattern), return the first. If no group matches, return an empty string. This elides the response code from the server, since it can only be '215' or '285' (for xgtitle) anyway. If the response code is needed, use the 'descriptions' method. NOTE: This neither checks for a wildcard in 'group' nor does it check whether the group actually exists.F)r)rr rrr descriptionzs z_NNTPBase.descriptioncCs |j|dS)z'Get descriptions for a range of groups.T)r)rrrrr descriptionssz_NNTPBase.descriptionscCs|jd|}|jds t||j}d}}}t|}|dkr|d}|dkr|d}|dkr|d}|dkr|dj}|t|t|t||fS)aProcess a GROUP command. Argument: - group: the group name Returns: - resp: server response if successful - count: number of articles - first: first article number - last: last article number - name: the group name zGROUP rrr1rIrrJ)rrBrr?r7r3r@)rr:r}wordscountr"r!nrrrr s    z_NNTPBase.groupcCs |jd|S)aProcess a HELP command. Argument: - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of strings returned by the server in response to the HELP command ZHELP)r)rr`rrrhelpsz_NNTPBase.helpcCs8|jdst||j}t|d}|d}|||fS)z_Internal: parse the response line of a STAT, NEXT, LAST, ARTICLE, HEAD or BODY command.Z22r1rI)rBrr?r@)rr}rart_numr%rrr _statparses   z_NNTPBase._statparsecCs|j|}|j|S)z/Internal: process a STAT, NEXT or LAST command.)rr)rr9r}rrr_statcmds z_NNTPBase._statcmdcCs"|r|jdj|S|jdSdS)a(Process a STAT command. Argument: - message_spec: article number or message id (if not specified, the current article is selected) Returns: - resp: server response if successful - art_num: the article number - message_id: the message id zSTAT {0}ZSTATN)rrT)r message_specrrrstats z_NNTPBase.statcCs |jdS)z;Process a NEXT command. No arguments. Return as for STAT.ZNEXT)r)rrrrnextsz_NNTPBase.nextcCs |jdS)z;Process a LAST command. No arguments. Return as for STAT.ZLAST)r)rrrrr!sz_NNTPBase.lastcCs0|j||\}}|j|\}}}|t|||fS)z2Internal: process a HEAD, BODY or ARTICLE command.)rrr$)rr9r`r}rrr%rrr_artcmdsz_NNTPBase._artcmdcCs$|dk rdj|}nd}|j||S)a0Process a HEAD command. Argument: - message_spec: article number or message id - file: filename string or file object to store the headers in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of header lines) NzHEAD {0}ZHEAD)rTr)rrr`rrrrheads z_NNTPBase.headcCs$|dk rdj|}nd}|j||S)a+Process a BODY command. Argument: - message_spec: article number or message id - file: filename string or file object to store the body in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of body lines) NzBODY {0}ZBODY)rTr)rrr`rrrrbodys z_NNTPBase.bodycCs$|dk rdj|}nd}|j||S)a5Process an ARTICLE command. Argument: - message_spec: article number or message id - file: filename string or file object to store the article in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of article lines) Nz ARTICLE {0}ZARTICLE)rTr)rrr`rrrrarticles z_NNTPBase.articlecCs |jdS)zYProcess a SLAVE command. Returns: - resp: server response if successful ZSLAVE)r)rrrrslavesz_NNTPBase.slavecsDtjd|jdj|||\}}fdd|fdd|DfS)aiProcess an XHDR command (optional server extension). Arguments: - hdr: the header type (e.g. 'subject') - str: an article nr, a message id, or a range nr1-nr2 - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of (nr, value) strings z^([0-9]+) ?(.*) ?z XHDR {0} {1}csj|}|r|jddS|S)Nr1rI)rr )r9m)patrr remove_numbers z%_NNTPBase.xhdr..remove_numbercsg|] }|qSrr)rr9)rrrrsz"_NNTPBase.xhdr..)rrrrT)rZhdrrr`r}rr)rrrxhdr s  z_NNTPBase.xhdrcCs.|jdj|||\}}|j}|t||fS)aFProcess an XOVER command (optional server extension) Arguments: - start: start of range - end: end of range - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of dicts containing the response fields z XOVER {0}-{1})rrTrrG)rstartendr`r}rr8rrrxovers  z_NNTPBase.xoverc Csxd|jkrdnd}t|ttfr>|\}}|dj||p6d7}n|dk rR|d|}|j||\}}|j}|t||fS)aProcess an OVER command. If the command isn't supported, fall back to XOVER. Arguments: - message_spec: - either a message id, indicating the article to fetch information about - or a (start, end) tuple, indicating a range of article numbers; if end is None, information up to the newest message will be retrieved - or None, indicating the current article number must be used - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of dicts containing the response fields NOTE: the "message id" form isn't supported by XOVER ZOVERZXOVERz {0}-{1}r'Nrx)rdr)tuplerrTrrrG) rrr`rrrr}rr8rrrover(s z_NNTPBase.overc Csjtjdtdtjd}|jd||\}}g}x0|D](}|j|j}|r6|j|j ddq6W||fS)zProcess an XGTITLE command (optional server extension) Arguments: - group: group name wildcard (i.e. news.*) Returns: - resp: server response if successful - list: list of (name,title) stringszFThe XGTITLE extension is not actively used, use descriptions() insteadrIz^([^ ]+)[ ]+(.*)$zXGTITLE r1) warningswarnDeprecationWarningrrrrrr*r ) rr r`rr}Z raw_linesrrrrrrxgtitleCs  z_NNTPBase.xgtitlec Csjtjdtd|jdj|}|jds0t|y|j\}}Wntk r\t|Yn X||fSdS)zProcess an XPATH command (optional server extension) Arguments: - id: Message id of article Returns: resp: server response if successful path: directory path to article z(The XPATH extension is not actively usedrIz XPATH {0}Z223N) rrrrrTrBrr? ValueError)ridr}Zresp_numpathrrrxpathUs z_NNTPBase.xpathcCsb|jd}|jdst||j}t|dkr8t||d}t|dkrTt||t|dfS)zProcess the DATE command. Returns: - resp: server response if successful - date: datetime object ZDATEZ111rIr1N)rrBrr?r7r rS)rr}elemrrrrris    z_NNTPBase.datecCs|j|}|jdst|t|ttfr2|j}xB|D]:}|jtsT|j dt}|jdrfd|}|j j |q8W|j j d|j j |j S)N3s rs. )rrBrr)r bytearray splitlinesendswithrrstripr`rrrb)rrfr}r9rrr_postzs       z_NNTPBase._postcCs |jd|S)zProcess a POST command. Arguments: - data: bytes object, iterable or file containing the article Returns: - resp: server response if successfulZPOST)r)rdatarrrpostsz_NNTPBase.postcCs|jdj||S)a Process an IHAVE command. Arguments: - message_id: message-id of the article - data: file containing the article Returns: - resp: server response if successful Note that if the server refuses the article an exception is raised.z IHAVE {0})rrT)rr%rrrrihavesz_NNTPBase.ihavecCs|jj|`dS)N)r`r)rrrrrrs z_NNTPBase._closec Csz|jd}Wd|jX|S)zdProcess a QUIT command and close the socket. Returns: - resp: server response if successfulZQUITN)rrr)rr}rrrros z_NNTPBase.quitc Cs|jrtd| r"| r"tdy>|r^| r^ddl}|j}|j|j}|r^|d}|d}Wntk rtYnX|s~dS|jd|}|jdr|st|n |jd|}|jdst |d|_ |j |j rd |j kr|j d|_ |j dS) NzAlready logged in.z7At least one of `user` and `usenetrc` must be specifiedrrIzauthinfo user Z381zauthinfo pass Z281r^)rirnetrcZauthenticatorsr_rprrBrrrdrerfrg)ruserpasswordusenetrcrZ credentialsZauthr}rrrlogins<       z_NNTPBase.logincCs`y|jd|_WnJtk r$Yn8tk rZ}z|jjdrHd|_nWYdd}~XnXdS)Nz mode readerZ480T)rrcrrr rBrf)rerrrrgs z_NNTPBase._setreadermodecCs||jrtd|jrtd|jd}|jdrp|jjt|j||j |_|jj d|_d|_d|_ |j nt ddS) zzProcess a STARTTLS command. Arguments: - context: SSL context to use for the encrypted connection zTLS is already enabled.z+TLS cannot be started after authentication.STARTTLSZ382rwbTNzTLS failed to start.)rhrrirrBr`rr[rYr_makefilerdrer)rrZr}rrrstarttlss    z_NNTPBase.starttls)T)N)N)N)N)N)N)N)N)N)NNT)N)9rrrrrrr rlrsrvrerdebugrrrrbrrrrrrrzrrrrrrr rrrrrr!rrrrrrrrrrrrrrrrrorrg _have_sslrrrrrr\(sj .    .         ) r\c@s*eZdZeddddefddZddZdS)rNFc Cs||_||_tj||f||_d}y8|jjd}tj||||||sJ|rX|j|||Wn$|rn|j |jj YnXdS)a,Initialize an instance. Arguments: - host: hostname to connect to - port: port to connect to (default the standard NNTP port) - user: username to authenticate with - password: password to use with username - readermode: if true, send 'mode reader' command after connecting. - usenetrc: allow loading username and password from ~/.netrc file if not specified explicitly - timeout: timeout (in seconds) used for socket connections readermode is sometimes necessary if you are connecting to an NNTP server on the local machine and intend to call reader-specific commands, such as `group'. If you get unexpected NNTPPermanentErrors, you might need to set readermode. Nr) r_portsocketcreate_connectionrYrr\r rr) rr_rrrrjrrkr`rrrr s   z NNTP.__init__c Cs ztj|Wd|jjXdS)N)r\rrrYr)rrrrrr!sz NNTP._close)rrr NNTP_PORTrr rrrrrrrs "c@s,eZdZedddddefddZddZdS)NNTP_SSLNFc Cstj||f||_d} yJt|j|||_|jjd} tj|| |||d|sP|r^|j|||Wn$| rt| j|jjYnXdS)zThis works identically to NNTP.__init__, except for the change in default port and the `ssl_context` argument for SSL connections. Nr)rjrk) rrrYr[rr\r rr) rr_rrrZ ssl_contextrjrrkr`rrrr +s    zNNTP_SSL.__init__c Cs ztj|Wd|jjXdS)N)r\rrrYr)rrrrrrAszNNTP_SSL._close)rrr NNTP_SSL_PORTrr rrrrrrr)s  r__main__zJ nntplib built-in demo - display the latest articles in a newsgroup)rz-gz--groupzgmane.comp.python.generalz3group to fetch messages from (default: %(default)s))defaultrz-sz--serverznews.gmane.orgz+NNTP server hostname (default: %(default)s)z-pz--portr1z#NNTP port number (default: %s / %s))rtyperz-nz --nb-articles z2number of articles to fetch (default: %(default)s)z-Sz--ssl store_truezuse NNTP over SSL)actionrr)r_rrZGroupZhaszarticles, rangeZtocCs$t||kr |d|dd}|S)NrJz...)r7)sZlimrrrcutls rs&          X-