GitHub - DocNow/twarc-ids: A plugin for twarc2 to extract tweet ids from tweet JSON.


    

    
      Skip to content
      
    
      
      


            
  
    
        
          
        

          
            

          


        
              
                Sign up
              
              
                Sign up
              

          
            
          
        

    


    
      
        
          
        
      


        
          	
                
                  
                    Why GitHub?
                    
                      
                    
                  
                  
                    Features →
                    	Mobile →
	Actions →
	Codespaces →
	Packages →
	Security →
	Code review →
	Project management →
	Integrations →



                    	GitHub Sponsors →
	Customer stories→


                  

                
              
	
                Team
              
	
                Enterprise
              
	
                
                  
                    Explore
                    
                      
                    
                  

                  
                    	Explore GitHub →



                    Learn and contribute

                    	Topics →
	Collections →
	Trending →
	Learning Lab →
	Open source guides →



                    Connect with others

                    	The ReadME Project →
	Events →
	Community forum →
	GitHub Education →
	GitHub Stars program →


                  

                
              
	
                Marketplace
              
	
                
                  
                    Pricing
                    
                       
                    
                  

                  
                    Plans →

                    	Compare plans →
	Contact Sales →



                    	Education →


                  

                
              


        

      
          
            
  
    
      
        
          
          
            

            
              
	
  
    
      
      
      
    


    

    
    


    
      
        In this repository
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  




	
    No suggested jump to results
  



	
  
    
      
      
      
    


    

    
    


    
      
        In this repository
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  

	
  
    
      
      
      
    


    

    
    


    
      
        In this organization
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  

	
  
    
      
      
      
    


    

    
    


    
      
        In this repository
      
      
        All GitHub
      
      ↵
    


    
      Jump to
      ↵
    

  




            

      

  




          


        
          Sign in
        
            
              Sign up
            
            
              Sign up
            
      

    

  



    


  






    


  
    
  
    
      
    
    
      {{ message }}


  



  




    

  




  
        
    
      

      
    






  


  

      

        
            
    
  
    DocNow
  
  /
  
    twarc-ids
  
  




        


          	
      
    
    Notifications

  
	
          
      
      
        Star

    
      1
    

  
	
        
          
          Fork

      
        0
      
  



      

          
      
        A plugin for twarc2 to extract tweet ids from tweet JSON.
      

      
        
          
            MIT License
        
      

    
      
        
        1
        star
      
        
        0
        forks
    

    
      
            
      
      
        Star


      

      
          
    
    Notifications

      

    

  


        

  

    	
  
    
                  
          Code
            

    

	
  
    
                  
          Issues
            0

    

	
  
    
                  
          Pull requests
            0

    

	
  
    
                  
          Actions
            

    

	
  
    
                  
          Projects
            0

    

	
  
    
                  
          Security
            

    

	
  
    
                  
          Insights
            

    



            
            
            
            More
          


            
  
            	
                  
                    Code
                
	
                  
                    Issues
                
	
                  
                    Pull requests
                
	
                  
                    Actions
                
	
                  
                    Projects
                
	
                  
                    Security
                
	
                  
                    Insights
                









  




  

    
      
    
  
    
  



  

        





      
  

  
    
      
      main
      
    

      

  
    
      Switch branches/tags
      
    

    
      
        
          
        


        
          Branches
          Tags
        


        
          

              
    Nothing to show




            
            
              
                
  
  

              

            


              
  
    
    {{ refName }}
    default
  



              View all branches
          

        


        
          

            
              Nothing to show

            

              
  
    
    {{ refName }}
    default
  



            
              
                
  
  

              

            

              View all tags
          
        

      
    
  




  





  
    
      
      1
      branch
    
    
      
      0
      tags
    
  


  


    
      Go to file




    
        

  
    
      
      Code
      
    
      
        
          
            
  



  
  Clone





  
    
          
            HTTPS
          
            GitHub CLI
    

  


  
    
  
  
    
  




    
        Use Git or checkout with SVN using the web URL.
    

  



  
    
  
  
    
  




    
      Work fast with our official CLI.
      Learn more.
    

  



          

          	
              
                
                Open with GitHub Desktop
            
	
              
                
                Download ZIP
            


        


        
          Launching GitHub Desktop

          If nothing happens, download GitHub Desktop and try again.

          Go back
        


        
          Launching GitHub Desktop

          If nothing happens, download GitHub Desktop and try again.

          Go back
        


        
          Launching Xcode

          If nothing happens, download Xcode and try again.

          Go back
        


        
          Launching Visual Studio

          If nothing happens, download the GitHub extension for Visual Studio and try again.

          Go back
        


      

    

  



      
    




      


  
    Latest commit

    
      
        

         

      
        Git stats

        	
            
              
              
                    15
                    
                      commits
                    
              
            
          


      

    

  

  Files

  


  
      Permalink

  
  
  
    Failed to load latest commit information.


  

  
    
      
        Type

        Name

        Latest commit message

        Commit time

      


        
          
              
          


          
            test-data
          


          
               

          


          
               

          


        

        
          
              
          


          
            .gitignore
          


          
               

          


          
               

          


        

        
          
              
          


          
            LICENSE
          


          
               

          


          
               

          


        

        
          
              
          


          
            README.md
          


          
               

          


          
               

          


        

        
          
              
          


          
            setup.cfg
          


          
               

          


          
               

          


        

        
          
              
          


          
            setup.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            test_twarc_ids.py
          


          
               

          


          
               

          


        

        
          
              
          


          
            twarc_ids.py
          


          
               

          


          
               

          


        

    

    
      
        View code
      
    

  








  
    

      
        
          
            README.md
          

        

      


          
  
    
    

  




        
          twarc-ids

This module is a simple example of how to create a plugin for twarc. It uses
click-plugins to extend the main twarc command, and to manage the command
line options.

First you need to install twarc and this plugin:

pip install twarc
pip install twarc-ids


Now you can collect data using the core twarc utility:

twarc search blacklivesmatter > tweets.jsonl


And you have a new subcommand ids that is supplied by twarc-ids.

twarc ids tweets.jsonl > ids.txt


It's good practice to include some tests for your module. See
test_twarc_ids.py for an example. You can run it directly with pytest or
using:

python setup.py test


When creating your setup.py make sure you don't forget the entry_points magic
so that twarc will find your plugin when it is installed!


        

    







          

      
        
          
            About


    
      A plugin for twarc2 to extract tweet ids from tweet JSON.
    



  Resources

  
    
      
      Readme
  


  License

  
    
      
        MIT License
    
  


          

        

          
            
              
  
    Releases



    No releases published


            

          

          
            
              
  
    Packages 0




      
        No packages published 

      




            

          

          
            
              

            

          

          
            
              Languages


  
    


	
      
        
        Python
        100.0%
      
    



            

          

      









  




    
  


  


          

  
    	© 2021 GitHub, Inc.
	Terms
	Privacy
	Security
	Status
	Docs



    
      

    	Contact GitHub
	Pricing
	API
	Training
	Blog
	About


  

  
    
  


  





  
    
    
      
    
    You can’t perform that action at this time.
  


  
    
    You signed in with another tab or window. Reload to refresh your session.
    You signed out in another tab or window. Reload to refresh your session.