Social Feed Manager is open source software that harvests social media data and web resources from Twitter, Tumblr, Flickr, and Sina Weibo. It empowers researchers, faculty, students, and archivists to define and create collections of social media data. By running Social Feed Manager on behalf of their communities, cultural heritage and research organizations can provide an innovative service. Members of the GW community who wish to collect social media data will find more information at GW Libraries.
We collect tweets from almost every member of Congress, and we provide the list of handles here.
On May 18, Twitter announced changes to its Developer Policy that has significant impacts for researchers and archivists. The goal of this blog post is to de...
In version 1.8 of Social Feed Manager, we treated ourselves to a handful of enhancements and fixes.
Here's what we collected on May 4, 2017 with SFM.
SFM provides the opportunity to collect useful metadata about the geographic location of tweets provided by the Twitter API.
A quick blog post for a quick release.
On March 28, two dozen George Washington University faculty gathered over lunch to discuss social media research.
This post describes the impact of recent changes made by Twitter to allow extended tweets on the REST and Streaming APIs.
In between GW’s spring break and late season snow storm, we squeaked in version 1.6 of Social Feed Manager.
We're pleased to share some recently-developed guidelines on building social media archives.
Instructions are now available for exporting a dataset from SFM and publishing to Dataverse.
We've made incremental improvements to several key features in version 1.5.
Under the wire, version 1.4 is our 8th release of SFM for 2016.
The SFM team released a dataset of 280 million tweet ids related to the 2016 U.S. presidential election.
To help our future selves (and you), we've documented some of the tips and tricks for processing Twitter data with jq.
The highlights of version 1.3 of Social Feed Manager.
A Jupyter notebook that explores the affordances of the Twitter API for retweets, replies, quotes, and favorites.
This blog post describes how to get your content OUT of SFM.
The SFM team has overcome the confluence of a series of conferences, vacations, holidays, nasty colds, and other deadlines to get version 1.2 wrapped up.
Version 1.2 of Social Feed Manager will contain a passel of improvements to our social media harvesters.
In between summer vacations and public transit hurdles, we've cranked out release version 1.1 of Social Feed Manager.
The Twitter API is a powerful tool for archiving, but its use poses particular challenges for archivists.
Last week, Internet Archive put out a call for URL nominations for a Pulse Nightclub web collection. This blog post describes how I extracted 200,094 unique ...
We're pleased to release version 1.0 of Social Feed Manager, which includes the functionality to select, create, manage, and explore social media collections.
This week, GW Libraries' software development librarians working on Social Feed Manager participated in the Archives Unleashed 2.0 hackathon hosted at the Li...
It is heartbreaking that our first use of SFM to capture a breaking event was for the shooting at the Pulse Nightclub. My thoughts go out to the families, t...
We'e abandoning record segmentation for harvesting the Twitter Streaming API to WARC files and trying a new approach.
This is a guide for programmers and researchers who intend to use Weibo's API. Since the current official documentation hasn't been updated for a long time, ...
In her blog post, “Social Media for Good: the Series, Episode 2”, DPC’s Sara Day Thomson explains: New work also reveals the heightened importance of archive...
The latest in our social media harvesting experiments for the Social Feed Manager project involves analysis, discovery, and visualization of social media con...
The Twitter Streaming API is very powerful, allowing harvesting tweets not readily available from the other APIs.
Social Feed Manager (SFM) is a tool developed by the Scholarly Technology Group for harvesting social media to support research and build archives. As part o...
Social Feed Manager is supported by a grant from the National Historical Publications & Records Commission