twarc/utils at main · DocNow/twarc · GitHub


    

    
      Skip to content
      
    
      
      


            
  
    
        
          
        

          
            

          


        
              
                Sign up
              
              
                Sign up
              

          
            
          
        

    


    
      
        
          
        
      


        
          	
                
                  
                    Why GitHub?
                    
                      
                    
                  
                  
                    Features →
                    	Mobile →
	Actions →
	Codespaces →
	Packages →
	Security →
	Code review →
	Project management →
	Integrations →



                    	GitHub Sponsors →
	Customer stories→


                  

                
              
	
                Team
              
	
                Enterprise
              
	
                
                  
                    Explore
                    
                      
                    
                  

                  
                    	Explore GitHub →



                    Learn and contribute

                    	Topics →
	Collections →
	Trending →
	Learning Lab →
	Open source guides →



                    Connect with others

                    	The ReadME Project →
	Events →
	Community forum →
	GitHub Education →
	GitHub Stars program →


                  

                
              
	
                Marketplace
              
	
                
                  
                    Pricing
                    
                       
                    
                  

                  
                    Plans →

                    	Compare plans →
	Contact Sales →



                    	Education →


                  

                
              


        

      
          
            
  
    
      
        
          
          
            

            
              
	
  
    
      
      
      
    


    

    
    


    
      
        In this repository
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  




	
    No suggested jump to results
  



	
  
    
      
      
      
    


    

    
    


    
      
        In this repository
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  

	
  
    
      
      
      
    


    

    
    


    
      
        In this organization
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  

	
  
    
      
      
      
    


    

    
    


    
      
        In this repository
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  




            

      

  




          


        
          Sign in
        
            
              Sign up
            
            
              Sign up
            
      

    

  



    


  






    


  
    
  
    
      
    
    
      {{ message }}


  



  




    

  




  
        
    
      
      
    






  


  

      

        
            
    
  
    DocNow
  
  /
  
    twarc
  
  




        


          	
      
    
    Notifications

  
	
          
      
      
        Star

    
      1k
    

  
	
        
          
          Fork

      
        214
      
  



      

        

  

    	
  
    
                  
          Code
            

    

	
  
    
                  
          Issues
            53

    

	
  
    
                  
          Pull requests
            0

    

	
  
    
                  
          Actions
            

    

	
  
    
                  
          Projects
            0

    

	
  
    
                  
          Wiki
            

    

	
  
    
                  
          Security
            

    

	
  
    
                  
          Insights
            

    



            
            
            
            More
          


            
  
            	
                  
                    Code
                
	
                  
                    Issues
                
	
                  
                    Pull requests
                
	
                  
                    Actions
                
	
                  
                    Projects
                
	
                  
                    Wiki
                
	
                  
                    Security
                
	
                  
                    Insights
                









  




  

    
      
    
  
    

  
    
      
      main
      
    

      

  
    
      Switch branches/tags
      
    

    
      
        
          
        


        
          Branches
          Tags
        


        
          

              
    Nothing to show




            
            
              
                
  
  

              

            


              
  
    
    {{ refName }}
    default
  



              View all branches
          

        


        
          

            
              Nothing to show

            

              
  
    
    {{ refName }}
    default
  



            
              
                
  
  

              

            

              View all tags
          
        

      
    
  




  





    
      
        twarc/utils/
      

    


    
      
        Go to file

    

  


  twarc/utils/


  


  
    Latest commit

    
      
  
    
  
      
        
  




  

  
    
      
      edsu


  

        
          commit on every insert is slow when writing to a usb thumbdrive appar…
        
    

    
      
        …
      
    
    
        
      
        3dd7635
      
      
        Feb 27, 2021
      
    

  

  
      
        commit on every insert is slow when writing to a usb thumbdrive appar…
      

      …ently

    
      3dd7635
    

  

      
        Git stats

        	
            
              
              
                  History
              
            
          


      

    

  

  Files

  


  
      Permalink

  
  
  
    Failed to load latest commit information.


  

  
    
      
        Type

        Name

        Latest commit message

        Commit time

      

        
          
            
              . .
          

          

          

        


        
          
              
          


          
            auth_timing.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            deduplicate.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            deleted.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            deleted_users.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            deletes.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            embeds.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            emojis.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            extractor.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            filter_date.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            filter_users.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            flakey.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            foaf.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            gender.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            geo.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            geofilter.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            geojson.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            json2csv.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            media2warc.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            media_urls.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            network.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            noretweets.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            oembeds.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            remove_limit.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            retweets.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            search.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            sensitive.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            sort_by_id.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            source.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            tags.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            times.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            twarc-archive.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            tweet.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            tweet_compliance.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            tweet_text.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            tweet_urls.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            tweetometer.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            tweets.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            unshrtn.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            urls.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            users.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            validate.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            wall.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            wayback.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            webarchives.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            wordcloud.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            youtubedl.py
          


          
               

          


          
               

          


        

    

  








  






  




    
  


  


          

  
    	© 2021 GitHub, Inc.
	Terms
	Privacy
	Security
	Status
	Docs



    
      

    	Contact GitHub
	Pricing
	API
	Training
	Blog
	About


  

  
    
  


  





  
    
    
      
    
    You can’t perform that action at this time.
  


  
    
    You signed in with another tab or window. Reload to refresh your session.
    You signed out in another tab or window. Reload to refresh your session.