chl6SrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK r SSK r SSKJr SSKrSSKrSSKrSr\R*S5rSrSrSrSS jrS rS r\R*S 5r\R*S 5r\R*S5rSr "SS5r!"SS\RDRF5r$\R*SS.Sj5r%Sr&Sr'Sr(Sr)Sr*Sr+g)z Utility functions for testing N)tagsc.[R"S5$)z# UHn[R"T5v M g7fNr).0r, RANDS_CHARSs r rands..ysE}!6==--}s#&)liststring ascii_lettersdigitsjoinr*)ncharsr3s @r randsr<ts7v++fmm;[R"5 [TR5T5$r1)gccollectgetattr memory_info)metricprocsr _get_use#memory_leak_check.._get_uses" t'')622r cP>T"5nUT- T:a[SUT- STS35eg)Nz.Memory leak detected. Departure from baseline z after z iterations) Exception) current_userE baseline_user, thresholds r _leak_check&memory_leak_check.._leak_checksEj  % 1@-.gaS E  2r )psutilProcessr*) frCrK iterationscheck_intervalrNrLrErJr,rDs `` @@@@r memory_leak_checkrS|sT* >> D3:L:   ~  " Mr c[RR5nURSS5n[RR [RR [RR [R555nU(a![RRX!45nOUnX0S'U$)N PYTHONPATHr/) osenvironcopygetpathabspathdirnamepa__file__pathsepr:)envexisting_pythonpath module_pathnew_pythonpaths r get_modified_env_with_pythonpathrds **// C'',3''//  457K+)KL$&  Jr cD[5n[RR[RR [ 55n[RR X05n[RU/nURU5 [R"XRS9 g)N)r`) rdrVrZr\realpathr^r:sys executableextend subprocess check_call) script_nameargssubprocess_envdir_path python_filecmds r invoke_scriptrrse57Nwwrww//9:H'',,x5K >>; 'CJJt#2r c#$# [RRU5nU[RU'Sv Uc[RU gU[RU'g!Uc[RU fU[RU'f=f7f)z9 Temporarily set environment variable *name* to *value*. N)rVrWrY)namevalue orig_values r changed_environrwsr %JBJJt*   4 )BJJt    4 )BJJt s3BA#)B#*B  Bc## [R"5n[R"[U55 Sv [R"U5 g![R"U5 f=f7fr1)rVgetcwdchdirr)rZcurdirs r change_cwdr|s@ YY[FHHSY  s5A.AA.A++A.c## [R"5 Sv [R"5 g![R"5 f=f7fr1)r?disableenabler r r disabled_gcrs(JJL   sA 3A A  A cF[RS:XaSU3nU$SU3nU$)Nntzfile:///zfile://)rVrt)rZuris r _filesystem_urirs3 ww$ Jv Jr c \rSrSrSrSrSrg)FSProtocolClasscXlgr1_pathselfrZs r __init__FSProtocolClass.__init__s r c,[UR5$r1)rrrs r __fspath__FSProtocolClass.__fspath__s4::r rN)__name__ __module__ __qualname____firstlineno__rr__static_attributes__r r r rrs r rc\rSrSrSrSrSrSrSrSr Sr S r S r S r S rS rSrSrSrSrSrSrSrSrg) ProxyHandlerz A dataset handler that proxies to an underlying filesystem. Useful to partially wrap an existing filesystem with partial changes. cXlgr1_fs)rfss r rProxyHandler.__init__sr cj[U[5(aURUR:H$[$r1 isinstancerrNotImplementedrothers r __eq__ProxyHandler.__eq__( e\ * *88uyy( (r cj[U[5(aURUR:g$[$r1rrs r __ne__ProxyHandler.__ne__rr c4SURR-$)Nzproxy::)r type_namers r get_type_nameProxyHandler.get_type_name s488----r c8URRU5$r1)rnormalize_pathrs r rProxyHandler.normalize_pathsxx&&t,,r c8URRU5$r1r get_file_info)rpathss r rProxyHandler.get_file_infosxx%%e,,r c8URRU5$r1r)rselectors r get_file_info_selector#ProxyHandler.get_file_info_selectorsxx%%h//r c4URRXS9$)N) recursive)r create_dir)rrZrs r rProxyHandler.create_dirsxx""4"==r c8URRU5$r1)r delete_dirrs r rProxyHandler.delete_dirsxx""4((r c6URRUUS9$)N)missing_dir_okrdelete_dir_contents)rrZrs r r ProxyHandler.delete_dir_contentss%xx++D;I,K Kr c6URRSSS9$)Nr/T)accept_root_dirrrs r delete_root_dir_contents%ProxyHandler.delete_root_dir_contents!sxx++B+EEr c8URRU5$r1)r delete_filers r rProxyHandler.delete_file$sxx##D))r c8URRX5$r1)rmoversrcdests r rProxyHandler.move'sxx}}S''r c8URRX5$r1)r copy_filers r rProxyHandler.copy_file*sxx!!#,,r c8URRU5$r1)ropen_input_streamrs r rProxyHandler.open_input_stream-sxx))$//r c8URRU5$r1)ropen_input_filers r rProxyHandler.open_input_file0sxx''--r c4URRXS9$N)metadata)ropen_output_streamrrZrs r rProxyHandler.open_output_stream3xx**4*CCr c4URRXS9$r)ropen_append_streamrs r rProxyHandler.open_append_stream6rr rN)rrrr__doc__rrrrrrrrrrrrrrrrrrrr r r rrse   .--0>)KF*(-0.DDr rFwarn_on_full_bufferc## [R"5upSnURS5 URS5 [R"UR 5US9nUv Ub[R"U5 UR 5 UR 5 g!Ub[R"U5 UR 5 UR 5 f=f7f)NFr)socket socketpair setblockingsignal set_wakeup_fdfilenoclose)rrwold_fds r signal_wakeup_fdr:s    DA F  e e%% HHJ,?A     (         (    sCA B &:C ;CCcUS/n[R"U[R[RSS9nURS5S:wa SSS5 gURR 5nUS-n[ R"XT5nU(a(URS5n[U5U:sSSS5 $[S 5e!,(df  g=f) Nz --versionutf-8stdoutstderrencodingrrFz version RELEASE\.(\d+)-.*rz+minio component older than the minimum year) rjPopenPIPEwaitrreadresearchgroupintFileNotFoundError) component minimum_year full_argsrDrpattern version_match version_years r _ensure_minio_component_versionr MsK(I   )JOO!+7 DGK 99R=A  D D!!#;; '2 (..q1L|$ 4 D D$=? ? D DsCAC< C Cc .[R"5n[R"5U- S:a[USSSSU3X#5 g[ S5e![a [R"S5 Of=f[R"5U- S:aMdNP)Nraliassetmyminiozhttp://rz+mc command could not connect to local minio)time_run_mc_commandChildProcessErrorsleeprH)mcdiraddress access_key secret_keystarts r _wait_for_minio_startupr^s IIKE ))+  "  E7E9%gY/ I  A BB!  JJqM  ))+  "sA A54A5cSSU/[U5-n[R"U[R[RSS9nUR S5nSR U5n[ SU35 [ SU35 [ S URR535 [ S URR535 US :wa [S 5eSSS5 g!,(df  g=f) Nmcz-Crrr zCmd: z Return: z Stdout: z Stderr: rzCould not run mc) r6rjrrrr:printrrrr)rrmrrDretvalcmd_strs r rrjstU#d4j0I   )JOO!+7 DGK2((9% gY  6(#$ 4;;++-./0 4;;++-./0 Q;#$67 7  D D Ds BC++ C9c "[RS:Xa[R"S5 [ SS5 [ SS5 USnUSupVpxUSU3n [ R RUS5n [ R RU 5(a[R"U 5 [ R"U 5 [ R RUS 5n [U S S 9n U RU5 S S S 5 [XXx5 [U S SSSX#5 [U S SSSSU 5 [U S SSSSSU5 [U SSS5 g !,(df  N\=f![ a [R"S5 g f=f)aF Attempts to use the mc command to configure the minio server with a special user limited:limited123 which does not have permission to create buckets. This mirrors some real life S3 configurations where users are given strict permissions. Arrow S3 operations should still work in such a configuration (e.g. see ARROW-13685) win32z*The mc command is not installed on Windowsriminiotempdir connection:zlimited-buckets-policy.jsonr)modeNadminuseraddzmyminio/policycreatezno-create-bucketsattachz--usermbzmyminio/existing-bucketz--ignore-existingz"Configuring limited s3 user failed)rgplatformpytestskipr rVrZr:existsshutilrmtreemkdiropenwriterrr) s3_serverr+usernamepasswordr$hostportrrrr policy_path policy_files r _configure_s3_limited_userr?xsb ||w  @A:'d3'6I&-6|-D*JF!D6" Wd+ 77>>% MM%  ggll7,IJ +C (K   f %)  Gw"H 8w("$7 Fw("$78 M t%>+ -) ( : 89:s+CE+2EAE+ E($E++ F FcSnS[R;a0[RR[RS5nU(d>[RR S5n[RRU5nU$)zg This is the default location where tz.cpp will look for (until we make this configurable at run-time) FPYARROW_TZDATA_PATHz%USERPROFILE%\Downloads\tzdata)rVrWrZr2 expandvars) tzdata_bool tzdata_paths r windows_has_tzdatarEsa K *ggnnRZZ0E%FG gg(()JK ggnn[1 r cl[R"5HnURS5(dM g g)z5 Checks whether it's running on musl systems or not. musllinuxTF)r platform_tags startswith) platform_tags r running_on_musllinuxrKs0**,  " "; / /- r )rssirr),r contextlibrr?rVrrr3rrr7rjrgr packagingrr0pyarrowr] pyarrow.fsr contextmanagerrr%r-r<rSrdrrrwr|rrrrFileSystemHandlerrrr rrr?rErKr r r rSs=$   " ((*"JCFFH%&)X  3  * *  ?D7:://?DD ,1$?" C 80:f r