import-gvhistory: Export Google Voice SMS/Text Messages and Call logs to CSV using Powershell

Here is a script I wrote to parse the thousands of HTML files produced by Google Takeout when exporting Google Voice data.  This script parses the html files to gather the Contact Name, Number, time, type (Placed/received etc), duration, and (text/voicemail) message contents for every phone call and text message, and outputs them as a powershell object which can be further filtered or manipulated and then exported into a csv or other format as needed.

Basic examples of how to use this script are included in the script comments.  If you download the script and have trouble, or if it works perfectly, please leave a comment and let me know.

**Update 12/20/2014** I've just posted step by step instructions for how to use the script..
**Update 11/16/2015** The script has been updated due to a change in how Google Takeout exports the timestamps.

Comments

  1. UnknownDecember 20, 2014 at 1:06 PM

    Hey. First and foremost, thank you for writing this. I've been looking for a way to make this data useful for a while. That being said, I'm having trouble getting this to work. I'm pretty new to PowerShell so I could just be doing something wrong but as of now, running the script just yields an empty CSV (or nothing at all if I don't include the export-csv part). Some guidance would be much appreciated. Thanks in advance!

    ReplyDelete
    Replies
    1. Steve WhitcherDecember 20, 2014 at 5:47 PM

      Thanks Peter. I've added a new post with step by step instructions, and updated this post with a link. If you have any more trouble let me know.

      Delete
    2. UnknownDecember 21, 2014 at 9:40 AM

      Thanks for the update and all of your help! The script wound up working perfectly!

      Delete
  2. UnknownDecember 21, 2014 at 7:35 PM

    I'm getting the following error when I run the script:

    Cannot find an appropriate constructor to instantiate the custom attribute object for type 'Alias'.
    At C:\temp\gvtext\import-gvhistory.ps1:32 char:11
    + [Alias <<<< ()]
    + CategoryInfo : InvalidOperation: (Alias:Token) [], Run
    + FullyQualifiedErrorId : CannotFindConstructorForCustomAttribute

    I'm sure it's probably something that should be obvious, but any help appreciated.

    ReplyDelete
    Replies
    1. Steve WhitcherDecember 21, 2014 at 8:00 PM

      Dann - That sounds like one of the same issues that Peter ran into. While you can safely comment out line 32 by putting a # at the beginning of the line, I suspect that the root of the issue may be that you're running an old version of powershell. Do you know which version your using?

      Win7 shipped with Powershell v2.0, but you can get version 4.0 (the latest available for Win7 currently) by downloading and installing the "Windows Management Framework 4" package from Microsoft. If you're running Windows 7 and don't have that installed already, then that's probably your issue.

      Delete
    2. UnknownDecember 21, 2014 at 10:17 PM

      That was it. Figured it'd be something like that. Thanks!

      Delete
  3. AnonymousDecember 29, 2014 at 1:11 AM

    i am using 4.0 and I get a bunch of these errors:

    New-Object : Cannot find type [HtmlAgilityPack.HtmlDocument]: verify that the assembly containing this type is loaded.
    At C:\voice\import-gvhistory.ps1:94 char:20
    + $doc = New-Object HtmlAgilityPack.HtmlDocument
    + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo : InvalidType: (:) [New-Object], PSArgumentException
    + FullyQualifiedErrorId : TypeNotFound,Microsoft.PowerShell.Commands.NewObjectCommand

    ReplyDelete
    Replies
    1. Steve WhitcherDecember 29, 2014 at 9:32 AM

      Houstonsolo - That error looks like the script wasn't able to access htmlagilitypack.dll for some reason. Make sure you have downloaded the html agility pack and extracted the appropriate dll file into the same directory as the script, and that you are in that directory when you run the script. In my post with step by step instructions, I used "c:\temp" as the working directory for this.

      Delete
  4. jeffroJuly 28, 2019 at 3:43 AM

    I know this is old, but maybe you are still monitoring. This script looks exactly like what I need, so thanks for sharing. I'm having a problem that may be outside your realm. Anyway, I abandoned windows a long time ago, but I'm not any kind of linux expert. I'm trying this on Linux Mint. I have Powershell core v. 6.2.2 installed and working. I have the GV archive, the script, the agility pack and the .dll. But I'm getting a lot of errors, almost all like:

    You cannot call a method on a null-valued expression.
    At /home/jeff/Documents/googlevoice/import-gvhistory.ps1:117 char:21
    + ... $Duration = $doc.documentnode.selectnodes(".//abbr[@class ...
    + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo : InvalidOperation: (:) [], RuntimeException
    + FullyQualifiedErrorId : InvokeMethodOnNull

    But also one:

    Sort : The term 'Sort' is not recognized as the name of a cmdlet, function, script file, or operable program.
    Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
    At /home/jeff/Documents/googlevoice/import-gvhistory.ps1:209 char:22
    + $GVHistory | Sort Time
    + ~~~~
    + CategoryInfo : ObjectNotFound: (Sort:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException


    Is this just what I get for trying to run a windows powershell script on linux when I don't really know what I'm doing? Or is there some way around this?
    Thanks so much!

    ReplyDelete
  5. pabussJanuary 26, 2021 at 11:10 AM

    I know this code is really old, but thanks for putting it together. I had to change the Get Date function, but after that it worked like a charm.

    ReplyDelete
    Replies
    1. TsolutionsJune 5, 2022 at 10:40 PM

      Hi I would really appreciate the update you made to the Get Date function. Could you kindly share the updated script with me? My email is malik@theteleworksolution.com

      Delete

Post a Comment

Popular posts from this blog

Mystery Solved: Bitlocker is enabled, but Intune shows the computer as non-compliant for Require Bitlocker

For some time, I have struggled to understand why Intune reports some computers as non-compliant with the "Require Bitlocker" setting, even though Bitlocker is enabled and working on the computer.  In my searches for an explanation, I found the same question asked by many others, but never an answer.  Until today. I accidentally stumbled across this article from Microsoft's Rob Lane , which explains how the Require Bitlocker setting is evaluated and why it might seem to incorrectly report a non-compliant state.  I encourage you to check out that article for full details.  I'll just summarize here the part that suddenly made this bitlocker compliance issue make sense to me. The "Require Bitlocker" setting in Intune relies on the Device Health Attestation (DHA) service in Windows 10 to report the state of Bitlocker encryption on the computer.  If Bitlocker protection is disabled or suspended, DHA will report that the computer is non-compliant with this ...
Read more

Windows 10 Credential Guard breaks WiFi

Recently, I ran into an issue with computers running windows 10 that would not connect to our WPA2-Enterprise encrypted wifi network.  When it failed to connect, there was no indication of why, only the message "Can't connect to this network."  The computers were able to connect to unencrypted networks and networks using a Pre-shared key for WPA encryption without issue. Checking the event logs on the RADIUS server to see why the comptuer failed to connect, there was no log entry for a connection attempt from the affected system.  The WLAN-Auto-Config log on the client listed a couple of errors, including Event ID 11006 and 12013, but other than showing that the failure reason was "Explicit EAP failure received", they didn't give much to go on: Log Name:      Microsoft-Windows-WLAN-AutoConfig/Operational Source:        Microsoft-Windows-WLAN-AutoConfig Date:          8/15/2016 1:11:20 PM Event ID:   ...
Read more

Data Sharing Service crashes on Windows Server 2016 - Event ID 7023

Image
While troubleshooting an issue recently on a Windows Server 2016 system, I noticed errors on the System event log about the Data Sharing Service crashing. The Data Sharing Service service terminated with the following error: %%3239247874 Searching online for more information about this service and why it might be failing, I came across a lot of people describing similar problems, but the only explanation and solution I found came from this December  blog post by Microsoft Japan .    Google translate did a great job making the post understandable to me, but since the information doesn't seem to have been widely publicized I thought I'd share it here to help get the word out. The Data Sharing Service fails due to a resource conflict with another service included in Server 2016, the User Access Logging Service.  Either one of these services alone will run without issue, but if one is already running and you try to start the other, it will fail. According to...
Read more