Dwarfsoft [GPA] » Tweet http://www.dwarfsoft.com/blog Great Programming Artistry Tue, 06 Sep 2011 11:18:59 +0000 en hourly 1 http://wordpress.org/?v=3.3.2 SEP11 Scan Logs http://www.dwarfsoft.com/blog/2011/03/03/sep11-scan-logs/ http://www.dwarfsoft.com/blog/2011/03/03/sep11-scan-logs/#comments Thu, 03 Mar 2011 01:29:08 +0000 dwarfsoft http://www.dwarfsoft.com/blog/2011/03/03/sep11-scan-logs/ I will start out by simply stating how much I HATE SEP11, and how it handles client scan logs. For some reason there is NO way of getting a client scan log out of the Central Management Console. The whole point of Central Management is being able to … manage CENTRALLY.

Anyway, enough rant. I wrote a batch file to pull the latest (or specified) log file from a list of servers (in a file called Servers.txt). More Source:

@echo off
if not exist "SEP11Logs" mkdir SEP11Logs
 
for /f "tokens=*" %%A IN (Servers.txt) DO (
  IF /I "%~1" EQU "" (
    CALL :GetLatestLog "%%A"
    CALL :CopyLog "%%A" "%%_LogFile%%"
    ) ELSE (
    CALL :CopyLog "%%A" "%~1"
    )
  )
 
GOTO:EOF
 
:GetLatestLog
SET _ServerName=%~1
FOR /F "tokens=* delims=" %%B IN ('dir "\\%_ServerName%\C$\Documents and Settings\All Users\Application Data\Symantec\Symantec Endpoint Protection\Logs\*.log" /b /o:-d') DO (
  SET _LogFile=%%B
  ECHO "Logfile is %%B"
  GOTO:EOF
  )
GOTO:EOF
 
:CopyLog
ECHO Copying "%~2" on "%~1"
COPY /Y "\\%~1\C$\Documents and Settings\All Users\Application Data\Symantec\Symantec Endpoint Protection\Logs\%~2" "SEP11Logs\%~1-%~2"
:EOF

This script goes through the list of servers copying the logs into a folder called SEP11Logs and renaming them to “<ServerName>-<Logname>” so they come out as something like “SERVER-02262011.log”.

Once I received the logs I was then struck with a problem of not being able to easily determine the date and time of each finding. After a short search I managed to track down a description of the SEP11 log file format. I wrote a quick and [very] dirty script to add a little more detail to the original log.

' See http://www.symantec.com/business/support/index?page=content&id=TECH100099&locale=en_US
On Error Resume Next
Const ForReading = 1
Const ForWriting = 2
 
Dim fso, folder, files, NewsFile,sFolder
 
Set fso = CreateObject("Scripting.FileSystemObject")
sFolder = Wscript.Arguments.Item(0)
If sFolder = "" Then
    Wscript.Echo "No Folder parameter was passed"
    Wscript.Quit
End If
Set folder = fso.GetFolder(sFolder)
Set files = folder.Files
 
For each folderIdx In files
 
  Set LogFile = fso.OpenTextFile(folderIdx.Path, ForReading)
  Set LogFileCsv = fso.CreateTextFile(folderIdx.Path& ".csv", True)
  Do While not LogFile.AtEndOfStream
    line = LogFile.ReadLine
	Splt=Split(line,",")
	hTime = Splt(0)
	hTimeYear  = Right("0000" & (1970 + CLng("&H"&Mid(hTime,1,2))),4)
	hTimeMonth = Right("00" & CLng("&H"&Mid(hTime,3,2))+1,2)
	hTimeDay   = Right("00" & CLng("&H"&Mid(hTime,5,2)), 2)
	hTimeHour  = Right("00" & CLng("&H"&Mid(hTime,7,2)), 2)
	hTimeMin   = Right("00" & CLng("&H"&Mid(hTime,9,2)), 2)
	hTimeSec   = Right("00" & CLng("&H"&Mid(hTime,11,2)), 2)
 
	hDateAndTime = hTimeYear & "-" & hTimeMonth & "-" & hTimeDay & " " & hTimeHour & ":" & hTimeMin & ":" & hTimeSec
	hDate = hTimeYear & "-" & hTimeMonth & "-" & hTimeDay
	hTime = hTimeHour & ":" & hTimeMin & ":" & hTimeSec
 
	Select Case Splt(1)
	  Case 1
	    hEvent = "GL_EVENT_IS_ALERT"
      Case 2
        hEvent = "GL_EVENT_SCAN_STOP"
      Case 3
        hEvent = "GL_EVENT_SCAN_START"
      Case 4
        hEvent = "GL_EVENT_PATTERN_UPDATE"
      Case 5
        hEvent = "GL_EVENT_INFECTION"
      Case 6
        hEvent = "GL_EVENT_FILE_NOT_OPEN"
      Case 7
        hEvent = "GL_EVENT_LOAD_PATTERN"
      Case 8
        hEvent = "//GL_STD_MESSAGE_INFO NOT USED"
      Case 9
        hEvent = "//GL_STD_MESSAGE_ERROR NOT USED"
      Case 10
        hEvent = "GL_EVENT_CHECKSUM"
      Case 11
        hEvent = "GL_EVENT_TRAP"
      Case 12
        hEvent = "GL_EVENT_CONFIG_CHANGE"
      Case 13
        hEvent = "GL_EVENT_SHUTDOWN"
      Case 14
        hEvent = "GL_EVENT_STARTUP"
      Case 16
        hEvent = "GL_EVENT_PATTERN_DOWNLOAD"
      Case 17
        hEvent = "GL_EVENT_TOO_MANY_VIRUSES"
      Case 18
        hEvent = "GL_EVENT_FWD_TO_QSERVER"
      Case 19
        hEvent = "GL_EVENT_SCANDLVR"
      Case 20
        hEvent = "GL_EVENT_BACKUP"
      Case 21
        hEvent = "GL_EVENT_SCAN_ABORT"
      Case 22
        hEvent = "GL_EVENT_RTS_LOAD_ERROR"
      Case 23
        hEvent = "GL_EVENT_RTS_LOAD"
      Case 24
        hEvent = "GL_EVENT_RTS_UNLOAD"
      Case 25
        hEvent = "GL_EVENT_REMOVE_CLIENT"
      Case 26
        hEvent = "GL_EVENT_SCAN_DELAYED"
      Case 27
        hEvent = "GL_EVENT_SCAN_RESTART"
      Case 28
        hEvent = "GL_EVENT_ADD_SAVROAMCLIENT_TOSERVER"
      Case 29
        hEvent = "GL_EVENT_REMOVE_SAVROAMCLIENT_FROMSERVER"
      Case 30
        hEvent = "GL_EVENT_LICENSE_WARNING"
      Case 31
        hEvent = "GL_EVENT_LICENSE_ERROR"
      Case 32
        hEvent = "GL_EVENT_LICENSE_GRACE"
      Case 33
        hEvent = "GL_EVENT_UNAUTHORIZED_COMM"
      Case 34
        hEvent = "GL_EVENT_LOG_FWD_THRD_ERR"
      Case 35
        hEvent = "GL_EVENT_LICENSE_INSTALLED"
      Case 36
        hEvent = "GL_EVENT_LICENSE_ALLOCATED"
      Case 37
        hEvent = "GL_EVENT_LICENSE_OK"
      Case 38
        hEvent = "GL_EVENT_LICENSE_DEALLOCATED"
      Case 39
        hEvent = "GL_EVENT_BAD_DEFS_ROLLBACK"
      Case 40
        hEvent = "GL_EVENT_BAD_DEFS_UNPROTECTED"
      Case 41
        hEvent = "GL_EVENT_SAV_PROVIDER_PARSING_ERROR"
      Case 42
        hEvent = "GL_EVENT_RTS_ERROR"
      Case 43
        hEvent = "GL_EVENT_COMPLIANCE_FAIL"
      Case 44
        hEvent = "GL_EVENT_COMPLIANCE_SUCCESS"
      Case 45
        hEvent = "GL_EVENT_SECURITY_SYMPROTECT_POLICYVIOLATION"
      Case 46
        hEvent = "GL_EVENT_ANOMALY_START"
      Case 47
        hEvent = "GL_EVENT_DETECTION_ACTION_TAKEN"
      Case 48
        hEvent = "GL_EVENT_REMEDIATION_ACTION_PENDING"
      Case 49
        hEvent = "GL_EVENT_REMEDIATION_ACTION_FAILED"
      Case 50
        hEvent = "GL_EVENT_REMEDIATION_ACTION_SUCCESSFUL"
      Case 51
        hEvent = "GL_EVENT_ANOMALY_FINISH"
      Case 52
        hEvent = "GL_EVENT_COMMS_LOGIN_FAILED"
      Case 53
        hEvent = "GL_EVENT_COMMS_LOGIN_SUCCESS"
      Case 54
        hEvent = "GL_EVENT_COMMS_UNAUTHORIZED_COMM"
      Case 55
        hEvent = "GL_EVENT_CLIENT_INSTALL_AV"
      Case 56
        hEvent = "GL_EVENT_CLIENT_INSTALL_FW"
      Case 57
        hEvent = "GL_EVENT_CLIENT_UNINSTALL"
      Case 58
        hEvent = "GL_EVENT_CLIENT_UNINSTALL_ROLLBACK"
      Case 59
        hEvent = "GL_EVENT_COMMS_SERVER_GROUP_ROOT_CERT_ISSUE"
      Case 60
        hEvent = "GL_EVENT_COMMS_SERVER_CERT_ISSUE"
      Case 61
        hEvent = "GL_EVENT_COMMS_TRUSTED_ROOT_CHANGE"
      Case 62
        hEvent = "GL_EVENT_COMMS_SERVER_CERT_STARTUP_FAILED"
      Case 63
        hEvent = "GL_EVENT_CLIENT_CHECKIN"
      Case 64
        hEvent = "GL_EVENT_CLIENT_NO_CHECKIN"
      Case 65
        hEvent = "GL_EVENT_SCAN_SUSPENDED"
      Case 66
        hEvent = "GL_EVENT_SCAN_RESUMED"
      Case 67
        hEvent = "GL_EVENT_SCAN_DURATION_INSUFFICIENT"
      Case 68
        hEvent = "GL_EVENT_CLIENT_MOVE"
      Case 69
        hEvent = "GL_EVENT_SCAN_FAILED_ENHANCED"
      Case 70
        hEvent = "GL_EVENT_MAX_EVENT_NUMBER"
      Case 71
        hEvent = "GL_EVENT_HEUR_THREAT_NOW_WHITELISTED"
      Case 72
        hEvent = "GL_EVENT_INTERESTING_PROCESS_DETECTED_START"
      Case 73
        hEvent = "GL_EVENT_LOAD_ERROR_COH"
      Case 74
        hEvent = "GL_EVENT_LOAD_ERROR_SYKNAPPS"
      Case 75
        hEvent = "GL_EVENT_INTERESTING_PROCESS_DETECTED_FINISH"
      Case 76
        hEvent = "GL_EVENT_HPP_SCAN_NOT_SUPPORTED_FOR_OS"
      Case 77
        hEvent = "GL_EVENT_HEUR_THREAT_NOW_KNOWN"
	End Select
 
	Select Case Splt(2)
	  Case 1
	    hCategory = "GL_CAT_INFECTION"
	  Case 2
	    hCategory = "GL_CAT_SUMMARY"
	  Case 3
	    hCategory = "GL_CAT_PATTERN"
	  Case 4
	    hCategory = "GL_CAT_SECURITY"
	End Select
 
    hLogger = Splt(3)
	hComputer = Splt(4)
	hUser = Splt(5)
	hVirus = Splt(6)
	hFile = Splt(7)
 
	Select Case Splt(8)
	  Case 1
	    hAction = "Quarantine"
      Case 2
	    hAction = "Rename"
	  Case 3
	    hAction = "Delete"
	  Case 4
	    hAction = "Leave Alone"
	  Case 5
	    hAction = "Clean File"
	  Case 6
	    hAction = "Clean Macros"
	  Case Else
	    hAction = "Unknown Action"
	End Select
 
	Select Case Splt(9)
	  Case 1
	    hAction2 = "Quarantine"
      Case 2
	    hAction2 = "Rename"
	  Case 3
	    hAction2 = "Delete"
	  Case 4
	    hAction2 = "Leave Alone"
	  Case 5
	    hAction2 = "Clean File"
	  Case 6
	    hAction2 = "Clean Macros"
	  Case Else
	    hAction2 = "Unknown Action"
	End Select
 
	Select Case Splt(10)
	  Case 1
	    hAction3 = "Quarantine"
      Case 2
	    hAction3 = "Rename"
	  Case 3
	    hAction3 = "Delete"
	  Case 4
	    hAction3 = "Leave Alone"
	  Case 5
	    hAction3 = "Clean File"
	  Case 6
	    hAction3 = "Clean Macros"
	  Case 7
	    hAction3 = "Saved file as..."
      Case 8
	    hAction3 = "Sent to Intel (AMS)"
      Case 9
	    hAction3 = "Moved to backup location"
      Case 10
        hAction3 = "Renamed backup file"
      Case 11
        hAction3 = "Undo action in Quarantine View"
      Case 12
        hAction3 = "Write protected or lack of permissions - Unable to act on file"
      Case 13
	    hAction3 = "Backed up file"
	  Case Else
	    hAction3 = "Unknown Action"
	End Select
 
	hVirusType = Splt(11)
	hFlags = Splt(12)
	hDescription = Splt(13)
	hScanId = Splt(14)
	hNewExt = Splt(15)
	hGroupId = Splt(16)
	hEventData = Splt(17)
	hQuarantineID = Splt(18)
	hVirusID = Splt(19)
	hQuarantineStatus = Splt(20)
	hAccess = Splt(21)
 
	outline = hDate & "," & hTime & "," & Splt(1) & "," & hEvent & "," & Splt(2) & "," & hCategory & "," & Splt(3) & "," & Splt(4) & "," & Splt(5) & "," & Splt(6) & ","
	outline = outline & Splt(7) & "," & Splt(8) & "," & hAction & "," & Splt(9) & "," & hAction2 & "," & Splt(10) & "," & hAction3
	For i = 11 to UBound(Splt)
	  outline=outline&","&Splt(i)
	Next
 
	LogFileCsv.WriteLine(outline)
  Loop
  LogFileCsv.Close
  LogFile.Close
 
Next

I know, not exactly brimming with comments. I leave this code here, as is. Worked for me… Just take note, that in these logs there are a lot of files that get picked up that have 3 actions listed as  “Leave Alone” but (if opened in Excel) under column X it lists a File Remediation and a Delete action. The log file format is abysmal and the above linked description of the format does not accurately explain the remediation information… I have as yet been unable to determine which field of the description the remediation is supposed to be in.

So, Run the Batch File to copy the logs into the SEP11Logs folder. Run the VBScript with the path to SEP11Logs and it will create a copy of the log files with a .csv extension that has a bit more information.

Enjoy.

Cheers, Chris.

]]> http://www.dwarfsoft.com/blog/2011/03/03/sep11-scan-logs/feed/ 0 Group Policy Editing – Findings http://www.dwarfsoft.com/blog/2010/06/15/group-policy-editing-findings/ http://www.dwarfsoft.com/blog/2010/06/15/group-policy-editing-findings/#comments Tue, 15 Jun 2010 03:16:01 +0000 dwarfsoft http://www.dwarfsoft.com/blog/?p=309 I had started another post on Group Policy editing, and how the Policy files are structured, and how to use and improve on the existing Group Policy Editor tool. The post has been found to be far too epic, so I have decided to cover a smaller subset of recent finds.

As everybody is probably already aware, we use Novell ConsoleOne and Zenworks where I work. ConsoleOne has some interesting features that require that whenever a Group Policy is being edited it takes over as the policy on the machine that is editing it. Rather than have a useful tool like Microsofts Group Policy Management Console, Novell likes to replace the local Group Policy and then just run gpedit.msc. Which is where my first gripe about gpedit.msc comes in:

GPEdit.msc requires line by line entry of things like, for example, port exceptions and program exceptions for the Windows Firewall. This is usually not an issue except that, as I have discussed in previous posts, we have been moving towards a Windows Domain environment. Firewall Exception rules are configured within two places in Group Policy: Domain Profile and Standard Profile. I have found that there is a need to move our current Standard Profile settings across to the Domain Profile settings. After a bit of registry searching I found a neat trick for doing exactly that.

In Novell, when a GPO is opened in gpedit.msc the Group Policy Contents are loaded into the normal registry locations (as per a normal GPO being applied to user and machine) and the contents are also loaded under a specific pair of registry keys. The HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Group Policy Objects Key is created on loading gpedit.msc, and underneath a pair of Keys are created like {449E44B0-A4DC-4665-AE8F-68710E1BC1EC}Machine and {449E44B0-A4DC-4665-AE8F-68710E1BC1EC}User, where the GUID is randomly generated (or at least seems to be random) each time gpedit.msc is run. Under these keys are the branch on which the Group Policy Settings are configured.

So therefore in order to duplicate StandardProfile Settings I need to duplicate all keys and values underneath HKCU\Software\Microsoft\Windows\CurrentVersion\Group Policy Objects\{GUID}Machine\Software\Policies\Microsoft\WindowsFirewall\StandardProfile\, where {GUID} is the randomly generated GUID for editing a Group Policy Object. So far from my research I have never seen more than one GUID appear underneath the Group Policy Objects key, though your mileage may vary. So the first step is to get the User and Machine keys from under the Group Policy Objects key.

Const HKEY_CURRENT_USER = &H80000001
Const HKEY_LOCAL_MACHINE = &H80000002
 
Const REG_SZ = 1
Const REG_EXPAND_SZ = 2
Const REG_BINARY = 3
Const REG_DWORD = 4
Const REG_MULTI_SZ = 7
 
strComputer = "."
 
Set objReg=GetObject("winmgmts:{impersonationLevel=impersonate}!\\" & _
 strComputer & "\root\default:StdRegProv")
 
strKeyPath = "Software\Microsoft\Windows\CurrentVersion\Group Policy Objects\"
strStandardPath = "\Software\Policies\Microsoft\WindowsFirewall\StandardProfile\"
strDomainPath = "\Software\Policies\Microsoft\WindowsFirewall\DomainProfile\"
 
If keyExists(HKEY_CURRENT_USER,strKeyPath) Then
  subkeys = GetSubkeys(HKEY_CURRENT_USER,strKeyPath)
  If Not IsEmpty(subkeys) Then
    GPOMachine = subkeys(LBound(subkeys)) 
    GPOUser    = subkeys(UBound(subkeys))
 
    RegCopyTree HKEY_CURRENT_USER, strKeyPath & GPOMachine & strStandardPath, strKeyPath & GPOMachine & strDomainPath, False
  Else
    WScript.Echo "Policy not found, please try editing the policy manually"
  End If
Else
  WScript.Echo "Please start editing the Group Policy before running this script"
End If

The code here is the shell of the script. We need to flesh out the functions keyExists, GetSubkeys, RegCopyTree, and valueExists (which we can’t see just yet). So first we will have a look at keyExists:

Function keyExists(Hive, Key)
  On Error Resume Next
  Err.Clear
 
  ret = objReg.EnumValues(Hive,Key,arrValues,arrValueTypes)
 
  If ret <> 0 Then
    keyExists = False
  Else
    keyExists = True
  End If
  Err.Clear
  On Error Goto 0
End Function

Fairly straightforward, we try and enumerate the values of a key. If we succeed then the key does exist, otherwise it doesn’t. We will use the same principle for checking if a Value Exists.

Function valueExists(Hive, Key, ValueName)
  On Error Resume Next
  Err.Clear
 
  valueExists = False
  If Not keyExists(Hive, Key) Then
    Exit Function
  End If
 
  ret = objReg.EnumValues(Hive,Key,arrValues,arrValueTypes)
 
  If IsNull(arrValues) Then
    Exit Function
  End IF
 
  For i = LBound(arrValues) to UBound(arrValues)
    If LCase(CStr(arrValues(i))) = LCase(CStr(ValueName)) Then
	  valueExists = True
	  Exit Function
	End If
  Next
 
  valueExists = False
 
  Err.Clear
  On Error Goto 0
End Function

Here, we take the Enumeration of the Keys Values a step further and actually step through them looking for a match with ValueName. I have opted for a Case Insensitive search due to registry being case insensitive with value names.

Function GetSubkeys(Hive, Key)
  On Error Resume Next
  Err.Clear
 
  ret = objReg.EnumKey(Hive,Key,arrSubkeys)
 
  GetSubkeys = arrSubkeys
 
  Err.Clear
  On Error Goto 0
End Function

Possibly the simplest of the functions, GetSubkeys just returns an array of Keys underneath the current Key. The most indepth function we require is the RegCopyTree:

Function RegCopyTree(Hive, SrcKey, DestKey, Force)
  On Error Resume Next
  Err.Clear
  strComputer = "."
  Set StdOut = WScript.StdOut
  strValue = ""
  If Force <> True Then
    Force = False
  End If
 
  if Right(SrcKey,1) <> "\" Then SrcKey = SrcKey & "\"
  if Right(DestKey,1) <> "\" Then DestKey = DestKey & "\"
 
  ret = objReg.EnumValues(Hive,SrcKey,arrValueNames,arrValueTypes)
 
  For i= LBound(arrValueNames) To UBound(arrValueNames)
    'StdOut.WriteLine "Value Name: " & arrValueNames(i) 
	StdOut.WriteLine "Copying from: " & SrcKey & arrValueNames(i)
	StdOut.WriteLine "To          : " & DestKey & arrValueNames(i)
    StdOut.Write     "       Value: "
 
	If (Not valueExists(Hive, DestKey, arrValueNames(i))) Or Force Then
	  Select Case arrValueTypes(i)
			Case REG_SZ
				'StdOut.WriteLine "Data Type: String"
				'StdOut.WriteBlankLines(1)
				
				objReg.GetStringValue Hive, SrcKey, arrValueNames(i), strValue
				objReg.SetStringValue Hive, DestKey, arrValueNames(i), strValue
				StdOut.Write strValue
			Case REG_EXPAND_SZ
				'StdOut.WriteLine "Data Type: Expanded String"
				'StdOut.WriteBlankLines(1)
				
				objReg.GetExpandedStringValue Hive, SrcKey, arrValueNames(i), strValue
				objReg.SetExpandedStringValue Hive, DestKey, arrValueNames(i), strValue
				StdOut.Write strValue
 
			Case REG_BINARY
				'StdOut.WriteLine "Data Type: Binary"
				'StdOut.WriteBlankLines(1)
				
				objReg.GetBinaryValue Hive, SrcKey, arrValueNames(i), strValue
				objReg.SetBinaryValue Hive, DestKey, arrValueNames(i), strValue
				For Each x in strValue
		          StdOut.Write Hex(x) & " "
		        Next
 
			Case REG_DWORD
				'StdOut.WriteLine "Data Type: DWORD"
				'StdOut.WriteBlankLines(1)
				
				objReg.GetDWORDValue Hive, SrcKey, arrValueNames(i), strValue
				objReg.SetDWordValue Hive, DestKey, arrValueNames(i), strValue
 
				StdOut.Write Hex(strValue)
			Case REG_MULTI_SZ
				'StdOut.WriteLine "Data Type: Multi String"
				'StdOut.WriteBlankLines(1)
				
				objReg.GetMultiStringValue Hive, SrcKey, arrValueNames(i), strValue
				objReg.SetMultiStringValue Hive, DestKey, arrValueNames(i), strValue
				For Each x in strValue
		          StdOut.Write x
		        Next
		End Select 
 
		StdOut.WriteLine ""
    End If '' Force
  Next
 
  ret = objReg.EnumKey(Hive,SrcKey,arrSubkeys)
 
  For i = LBound(arrSubkeys) to UBound(arrSubkeys)
    If Not keyExists(Hive,DestKey & arrSubkeys(i)) Then
	  objReg.CreateKey Hive,DestKey & arrSubkeys(i)
	End If
	RegCopyTree Hive, SrcKey & arrSubkeys(i), DestKey & arrSubkeys(i), Force
  Next
 
  On Error Goto 0
End Function

This function takes the Hive, Source Key, Destination Key, and a Boolean Value to determine whether to Force overwriting existing values. It first creates the Destination key if it doesn’t already exist, then enumerates all values in the Source path, and writes them to the Destination path, creating new values or overwriting only if Force is set. This function has a lot of StdOut.Write calls to show the progress of the duplication. Running the script via CScript gives the following results:

Copying from: Software\Microsoft\Windows\CurrentVersion\Group Policy Objects\{678C8897-54AA-4FB9-AA72-6C227C287D12}Machine\Software\Policies\Microsoft\WindowsFirewall\StandardProfile\EnableFirewall
To          : Software\Microsoft\Windows\CurrentVersion\Group Policy Objects\{678C8897-54AA-4FB9-AA72-6C227C287D12}Machine\Software\Policies\Microsoft\WindowsFirewall\DomainProfile\EnableFirewall
       Value: 1
Copying from: Software\Microsoft\Windows\CurrentVersion\Group Policy Objects\{678C8897-54AA-4FB9-AA72-6C227C287D12}Machine\Software\Policies\Microsoft\WindowsFirewall\StandardProfile\AuthorizedApplications\Enabled
To          : Software\Microsoft\Windows\CurrentVersion\Group Policy Objects\{678C8897-54AA-4FB9-AA72-6C227C287D12}Machine\Software\Policies\Microsoft\WindowsFirewall\DomainProfile\AuthorizedApplications\Enabled
       Value: 1
...

This should simplify the time taken for duplicating from Standard to Domain profile. For future reference this has also made it far easier to import/export port/program exceptions from policies I am editing. In future I may incorporate this into my Group Policy Firewall Exceptions Excel Spreadsheet in VBA to allow writing updated policies to the Policy.

After running this the settings will be seen to have changed in the Group Policy Editor Window immediately. I have tested this and checked that the Logging file is not replaced by “…\standard.log” where it should be “…\domain.log”.

Cheers, Chris.

Attached: RegFirewallProfileDuplication.vbs

]]> http://www.dwarfsoft.com/blog/2010/06/15/group-policy-editing-findings/feed/ 0 SYSTEM Account Permissions http://www.dwarfsoft.com/blog/2010/05/25/system-account-permissions/ http://www.dwarfsoft.com/blog/2010/05/25/system-account-permissions/#comments Tue, 25 May 2010 01:08:45 +0000 dwarfsoft http://www.dwarfsoft.com/blog/?p=305 Recently I have been working on some rather complicated projects preparing our SOE to move from Novell eDirectory to an Active Directory environment. One of the packages I built was required to run periodically and so I set up a Scheduled Task to accomplish this. Rather than introduce a security risk by creating a new Administrator Account I just created the scheduled task to run as the local SYSTEM account. It turns out that the SYSTEM account does not have as much access as I required, especially when managing user registry hives.

After quite some time looking in to how to achieve my goal I came up with a rather simple, yet ultimately hacky, solution. Give the SYSTEM Account Administrative Privileges.

It turns out that the SYSTEM Account, despite not having Administrator level permissions, does have permission to modify group memberships. As such I came up with two functions to manage these permissions for itself:

'*****************************************************************
' Elevates the System Account to a Member of the Administrators Group
Function ElevateSystem
  strSystemUser = "WinNT://NT AUTHORITY/SYSTEM"
  Set objGroup = GetObject("WinNT://./Administrators,group")
  If Not objGroup.isMember(strSystemUser) Then
    objGroup.Add (strSystemUser)
  End If
End Function
 
'*****************************************************************
' Removes the System Account from the Administrators Group
Function RelegateSystem
  strSystemUser = "WinNT://NT AUTHORITY/SYSTEM"
  Set objGroup = GetObject("WinNT://./Administrators,group")
  If objGroup.isMember(strSystemUser) Then
    objGroup.Remove (strSystemUser)
  End If
End Function

I just run ElevateSystem at the start of the script and then RelegateSystem at the end of the script and I have no issue with permissions anymore.

Elegant, yet hacky. Hope somebody found this useful, because it sure beats creating (and then managing) a new Administrator User on thousands of Workstations.

N.B. I should also point out that if you are installing a script onto Workstations that you will be using this kind of workaround on, make sure you set the permissions on it. The last thing you need is somebody hijacking your script to do whatever they want with Administrative Privileges.

Cheers, Chris.

]]> http://www.dwarfsoft.com/blog/2010/05/25/system-account-permissions/feed/ 2 Last Login Time http://www.dwarfsoft.com/blog/2010/04/22/last-login-time/ http://www.dwarfsoft.com/blog/2010/04/22/last-login-time/#comments Thu, 22 Apr 2010 01:54:33 +0000 dwarfsoft http://www.dwarfsoft.com/blog/?p=300 I have recently been having a look into determining the Last Login Time of a user for a BGInfo implementation. Firstly I had a look at the getCurrentUserLastLoginTime script suggested for use with BGInfo. The limitation of this script, however, is that it will reset the login time to the last time the Windows login box was Authenticated against, which also includes the time that the workstation was unlocked.

In order to maintain current BGInfo information the implementation is running periodically, so this is unnacceptable. Therefore I had to work to resolve the issue manually. As I have had a fair bit of experience with Windows Profiles recently (see the last blog post) I was familiar with the ProfileLoadTimeHigh and ProfileLoadTimeLow registry keys in the ProfileList. So I set out to determine how to actually use these to determine the login time. I first wrote some code to get the User SID based on the users “%userdomain%” and “%username%”:

DIM oNet, strComputerName, strUserName, strUserDomain
SET oNet = CreateObject("WScript.Network")
strComputerName = oNet.Computername
strUserName = oNet.UserName
strUserDomain = oNet.UserDomain
SET oNet = nothing
 
Set WMI = GetObject("winmgmts:{impersonationLevel=impersonate}!\\.\root\cimv2")
 
SubKey = ""
 
Set wmiCol = WMI.ExecQuery ("SELECT Domain, Name, SID FROM Win32_Account where Name="""&strUserName&""" And Domain="""&strUserDomain&"""")
For each wmiItem in wmiCol
  SubKey = wmiItem.SID
  Exit For
Next

So I set Subkey to be the String SID of the user, which I could then use to read the ProfileLoadTimeHigh and ProfileLoadTimeLow keys for the correct profile. I used the basic script from MyITForum, however this failed to take into account the timezone on the local machine. Therefore the first thing I needed to do was get the users timezone.

tz = 0
For Each os In GetObject("winmgmts:").InstancesOf ("Win32_OperatingSystem")
  tz = os.CurrentTimeZone
  Exit For  
Next

Then I integrated the Timezone offset (in minutes) into the original ProfileLoadTime script.

Const HKEY_LOCAL_MACHINE = &H80000002
 
strReturn = ""
 
Set objReg = GetObject("winmgmts:{impersonationLevel=impersonate}!\\.\root\default:StdRegProv"  )
strKeyPath = "SOFTWARE\MICROSOFT\Windows NT\CurrentVersion\ProfileList\" & SubKey 
 
strValueName = "ProfileLoadTimeHigh"
Return = objReg.GetDWORDValue(HKEY_LOCAL_MACHINE,strKeyPath,strValueName,lngHighValue)
strValueName = "ProfileLoadTimeLow"
Return = objReg.GetDWORDValue(HKEY_LOCAL_MACHINE,strKeyPath,strValueName,lngLowValue)
If typename(lngHighValue) <> "Null" then
  NanoSecs = (lngHighValue * 2 ^ 32 + lngLowValue)
  '' /* Returns time in Workstation Timezone */
  DT = #1/1/1601# + (NanoSecs / 600000000 / 1440) + (tz / 1440)
  strReturn = CDate(DT)
End if

Finally the output is printed as per a standard BGInfo script

On Error Resume Next
	call WScript.Echo(strReturn)	'for cmd line
	call Echo(strReturn)	'for BGInfo
on error goto 0

This works for Power Users as well, which the original script did not (due to permissions issues). Hope this helped you in some way ;)

Cheers, Chris.

]]> http://www.dwarfsoft.com/blog/2010/04/22/last-login-time/feed/ 0 Shared User Profiles – Staging Scripts http://www.dwarfsoft.com/blog/2010/03/15/shared-user-profiles-staging-scripts/ http://www.dwarfsoft.com/blog/2010/03/15/shared-user-profiles-staging-scripts/#comments Mon, 15 Mar 2010 05:19:40 +0000 dwarfsoft http://www.dwarfsoft.com/blog/?p=291 As promised, here are the scripts required for the Pre-staging of Domain User Profiles on the local machine. The first thing we need to do is Enumerate all the Local User Accounts.

Function StageAllUsers(DomainFQDN, strDomain)
   ' Enumerate all users that are Local and not built in accounts.
   strComputer = "."
   Set objWMIService = GetObject("winmgmts:\\" & strComputer & "\root\cimv2")
   'Enumerate users where the User Domain is the Local Machine
   Set colItems = objWMIService.ExecQuery _
                  ("Select * from Win32_UserAccount " & _
                   "Where Domain = '" & GetComputerName & "' " & _
                   "And Disabled = FALSE And Name <> 'Administrator'")
   ' Stage each user
   For Each objItem In colItems
      ' Ensure the account actually has a profile (otherwise we can ignore it)
      If GetLocalUserProfile(objItem.Name) <> "" Then
         ret = StageUser(objItem.Name, DomainFQDN, strDomain)
      End If
   Next
End Function

The functions called here are GetComputerName, which returns the name of the local machine, and the other important ones are GetLocalUserProfile and Stage User. The first we can check is GetLocalUserProfile.

'Gets the Profile Path for the User passed in UserName.
' This requires the profile to exist on the local machine
' Returns an empty string on error
Function GetLocalUserProfile(UserName)
   On Error Resume Next
   GetLocalUserProfile = ""
   SDDL = GetLocalUserSDDL(UserName)
   If SDDL = "" Then
      Exit Function
   End If
   Set objShell = CreateObject("WScript.Shell")
   GetLocalUserProfile = objShell.ExpandEnvironmentStrings( _
                            objShell.RegRead( _
                               "HKLM\Software\Microsoft\Windows NT\CurrentVersion\ProfileList\" & _
                               SDDL & _
                               "\ProfileImagePath"))
  On Error Goto 0
End Function

The registry path (including the SDDL, covered next) returns the profile path for the user. This relies on a function called GetLocalUserSDDL which goes as follows:

Function GetLocalUserSDDL(UserName)
   strComputer = "."
   Set objWMIService = GetObject("winmgmts:\\" & strComputer & "\root\cimv2")
   'Enumerate users where the User Domain is the Local Machine
   'and the username matches the Supplied Name
   Set colItems = objWMIService.ExecQuery _
                     ("Select * from Win32_UserAccount  " & _
                      "Where Domain = '" & GetComputerName & "' " & _
                      "And Name = '" & UserName & "'")
   GetLocalUserSDDL = ""
   For Each objItem In colItems
      'Get the first returned SID/SDDL then exit
      GetLocalUserSDDL = objItem.SID
      Exit Function
   Next
End Function

This reads the SDDL (eg S-1-5-21-791012361-4073638415-1907800938-1006 or otherwise known as the String SID) for the User on the local machine. The next major function is Stage User:

Function StageUser(UserName, DomainFQDN, strDomain)
   Set objShell = CreateObject("WScript.Shell")
   ' Not Assuming "C:\Documents and Settings\" & UserName:
   '   Get SDDL of user via WMI interrogation of UserAccount
   '   Get Profile Location of user (from HKLM\Software\Microsoft\Windows NT\CurrentVersion\ProfileList\" & SDDL & "ProfileImagePath"
   strProfile = GetLocalUserProfile(UserName)
 
   ' Set ACLs on ProfileLocation
   ret = objShell.Run("subinacl /subdirectories """ & strProfile & """ /grant=""" & UserName & "@" & DomainFQDN & """=F",0,True)
 
   ' Set ACLs on D:\UserData\%username%
   ret = objShell.Run("subinacl /subdirectories ""D:\UserData\" & UserName & """ /grant=""" & UserName & "@" & DomainFQDN & """=F",0,True)
 
   ' Reg load ProfileLocation\NTUSER.DAT into HKU\%username%
   ret = objShell.Run("reg load ""HKU\" & UserName & """ """ & strProfile & "\NTUSER.DAT""" ,0,True)
   ' Reg load ProfileLocation\Local Settings\Application Data\Microsoft\Windows\UsrClass.DAT into HKU\%username%_Classes
   ret = objShell.Run("reg load ""HKU\" & UserName & "_Classes"" """ & strProfile & "\Local Settings\Application Data\Microsoft\Windows\UsrClass.DAT""" ,0,True)
 
   'Try both of the following. One should fail, the other should pass.
   ' Set ACLs on HKU\%username%
   ret = objShell.Run("subinacl /subkeyreg ""HKEY_USERS\" & UserName & """ /grant=""" & UserName & "@" & DomainFQDN & """=F",0,True)
   ' If User is already logged in then the registry will be open at HKU\SDDL
   ret = objShell.Run("subinacl /subkeyreg ""HKEY_USERS\" & GetLocalUserSDDL(UserName) & """ /grant=""" & UserName & "@" & DomainFQDN & """=F",0,True)
 
   'Try both of the following. One should fail, the other should pass.
   ' Set ACLs on HKU\%username%
   ret = objShell.Run("subinacl /subkeyreg ""HKEY_USERS\" & UserName & "_Classes"" /grant=""" & UserName & "@" & DomainFQDN & """=F",0,True)
   ' If User is already logged in then the registry will be open at HKU\SDDL
   ret = objShell.Run("subinacl /subkeyreg ""HKEY_USERS\" & GetLocalUserSDDL(UserName) & "_Classes"" /grant=""" & UserName & "@" & DomainFQDN & """=F",0,True)
 
   ' Reg unload HKU\%username%
   ret = objShell.Run("reg unload ""HKU\" & UserName & """",0,True)
   ' Reg unload HKU\%username%_Classes
   ret = objShell.Run("reg unload ""HKU\" & UserName & "_Classes""",0,True)
 
   ' Get Domain User SID from ProfileLocation ACL
   arrSID = GetDomainUserSidFromFolderACL(strProfile, UserName, strDomain)
 
   If UBound(arrSID) > 0 Then
      ' Convert Domain User SID to SDDL
      WScript.Echo "Getting Sid for " & UserName
      SDDL = ArraySidToStrSid(arrSID)
 
      ' Stage Domain User Profile into Registry under HKLM\Software\Microsoft\Windows NT\CurrentVersion\ProfileList\%DomainUserSDDL%
      ret = CreateAndLinkProfile(SDDL, arrSID, strProfile)
   Else
      'Account didn't exist in the domain or ACL failed to set on Folder
   End If
End Function

For the most part this function behaves by running external commands to mount registry hives, and set ACLs on folders and registry, all up until we call GetDomainUserSidFromFolderACL. This is where we retrieve the SID of the Domain User that we are pre-staging via the ACL we set earlier on the Local User Profile folder. This subverts the need to query Active Directory for the SID through other means.

Function GetDomainUserSidFromFolderACL(strFolder, strUserName, strUserDomain)
   Dim arrSID(0)
   GetDomainUserSidFromFolderACL = arrSID
 
   Set objFSO = CreateObject("Scripting.FileSystemObject")
   If Not objFSO.FolderExists(strFolder) Then
      Set objFSO = Nothing
      Exit Function
   End If
 
   ' Ensure that strFolder is of the form C:\\Documents and Settings\\UserName
    strFolderName = Replace(strFolder, "\\","\")
    strFolderName = Replace(strFolderName, "\","\\")
 
   Set wmiFileSecSetting = GetObject( _
      "winmgmts:Win32_LogicalFileSecuritySetting.path='" & strFolderName & "'")
 
   RetVal = wmiFileSecSetting. _
       GetSecurityDescriptor(wmiSecurityDescriptor)
   If Err <> 0 Then
       Exit Function
   End If
 
   ' Retrieve the DACL array of Win32_ACE objects.
   DACL = wmiSecurityDescriptor.DACL
 
   For each wmiAce in DACL
   ' Get Win32_Trustee object from ACE 
      Set Trustee = wmiAce.Trustee
      If (StrComp(Trustee.Name, strUserName, vbTextCompare) = 0) And _
         (StrComp(Trustee.Domain, strUserDomain, vbTextCompare) = 0) Then
         GetDomainUserSidFromFolderACL = Trustee.SID
         Exit Function
      End If
   Next
End Function

Although this subverts the need to Query Active Directory, this does also mean that we receive the SID in a format that is unexpected. Normally, via querying Active Directory we would have received a SID in an Octet String format. Querying the SID from WMI returned it in SDDL or String SID format. The format that we receive the SID from the ACL is in an Array of Integers. In order to Pre-stage an account we need the SDDL/String SID, and the only way to get this in VBScript is to manually convert it using some functions developed by Richard Mueller and Wilfred Wong in this newsgroup posting.

Instead of using only the code listed, we need to alter it for dealing with the SID array we received back from the ACL.

Function ArraySidToStrSid(arrSid)
   ' Function to convert OctetString (byte array) to Decimal string (SDDL) Sid.
   Dim strHex, strDec
 
   strHex = ArraySidToHexStr(arrSid)
   strDec = HexStrToDecStr(strHex)
   ArraySidToStrSid = strDec
End Function
 
Function ArraySidToHexStr(arrSid)
   ArraySidToHexStr = ""
   For Each x In arrSid
      ArraySidToHexStr = ArraySidToHexStr & _
         Right("0" & Hex(x), 2)
   Next
End Function

The HexStrToDecStr function is the same as it was from the Richard Mueller posting listed above.

Finally we just need to run through the actual staging of the account:

Function CreateAndLinkProfile(strNewSDDL, strNewSID, strProfilePath)
   WScript.Echo "Creating Profile for " & strNewSDDL & ": " & strProfilePath
   'Write Sid to registry
   ret = WriteRegBinaryToRegistry(HKEY_LOCAL_MACHINE,"SOFTWARE\Microsoft\Windows NT\CurrentVersion\ProfileList\" & strNewSDDL,"Sid",strNewSID)
   ret = WriteRegStringToRegistry(HKEY_LOCAL_MACHINE,"SOFTWARE\Microsoft\Windows NT\CurrentVersion\ProfileList\" & strNewSDDL,"ProfileImagePath",strProfilePath)
   ret = WriteRegStringToRegistry(HKEY_LOCAL_MACHINE,"SOFTWARE\Microsoft\Windows NT\CurrentVersion\ProfileList\" & strNewSDDL,"CentralProfile","")
   ret = WriteRegDwordToRegistry(HKEY_LOCAL_MACHINE,"SOFTWARE\Microsoft\Windows NT\CurrentVersion\ProfileList\" & strNewSDDL,"Flags",1)
   ret = WriteRegDwordToRegistry(HKEY_LOCAL_MACHINE,"SOFTWARE\Microsoft\Windows NT\CurrentVersion\ProfileList\" & strNewSDDL,"State",0)
End Function

At this point if the Domain User logs in they get redirected to the existing local users profile. Then if rollback is initiated they log on with the Local User account with the same profile. This is seamless to end users, both forward and backward.

On a side note the functions for writing to the registry are through WMI due to needing to write Binary values to the Registry

Function WriteRegBinaryToRegistry(Hive, strKeyPath, strValueName, ArrValues)
   strComputer = "."
   Set oReg = GetObject("winmgmts:{impersonationLevel=impersonate}!\\" & _
               strComputer & "\root\default:StdRegProv")
   oReg.CreateKey Hive,strKeyPath
 
   oReg.SetBinaryValue Hive, strKeyPath, strValueName,ArrValues
End Function
 
Function WriteRegDwordToRegistry(Hive, strKeyPath, strValueName, Value)
   strComputer = "."
   Set oReg = GetObject("winmgmts:{impersonationLevel=impersonate}!\\" & _
               strComputer & "\root\default:StdRegProv")
   oReg.CreateKey Hive,strKeyPath
 
   oReg.SetDwordValue Hive, strKeyPath, strValueName,Value
End Function
 
Function WriteRegStringToRegistry(Hive, strKeyPath, strValueName, Value)
   strComputer = "."
   Set oReg = GetObject("winmgmts:{impersonationLevel=impersonate}!\\" & _
               strComputer & "\root\default:StdRegProv")
   oReg.CreateKey Hive,strKeyPath
 
   oReg.SetStringValue Hive, strKeyPath, strValueName,Value
End Function

Cheers, Chris.

Edit: DomainAccountProfileStaging.vbs has been uploaded as a complete file.

]]> http://www.dwarfsoft.com/blog/2010/03/15/shared-user-profiles-staging-scripts/feed/ 9 Shared User Profiles – Alternative to Migration http://www.dwarfsoft.com/blog/2010/03/12/shared-user-profiles-alternative-to-migration/ http://www.dwarfsoft.com/blog/2010/03/12/shared-user-profiles-alternative-to-migration/#comments Fri, 12 Mar 2010 10:01:16 +0000 dwarfsoft http://www.dwarfsoft.com/blog/?p=287 Well, I have been very slack in that I haven’t updated with my Group Policy investigations or the eDirectory VBScript classes I was working on, but what I have been involved in recently is working on Migrating Workstations from Novell eDirectory to Active Directory.

In this process I have come across an array of options in migrating accounts from a Local User account to Domain User account and transferring the profiles across to keep the user “look and feel” that they are accustomed to.

One problem: In this scenario it makes for a very manual rollback strategy, no matter how much scripting and automation is involved in the migration process. This boils down to Novells implementation of “Dynamic Local User” which effectively creates a Local User Account that is not really bound to a User Account in eDirectory for Authentication or mapping purposes (which you can see if you look at the account SIDs).

So, how can you Migrate a local profile to a Domain User account while still maintaining a seamless rollback option (without using Roaming Profiles… This is out of the question)? The solution I have worked on is what I am terming “pre-staging” or “seeding” the Domain User Profile.

  1. Enumerate all Local Enabled Users (except for “Administrator”)
  2. Get the SID for that User (and the SDDL/String SID)
  3. Read the Profile Path for that User from Registry
  4. Set an ACL on that folder for <Domain>\<UserName> (we have the UserName being replicated between eDirectory and Active Directory
  5. Mount the existing users NTUser.dat into HKU\<UserName>
  6. Set ACL on HKU\<UserName> and all subkeys for <Domain>\<UserName>
  7. Set ACL on HKU\<LocalUserSID> and all subkeys for <Domain>\<UserName> (just in case the user is actually logged in)
  8. Dismount HKU\<UserName>
  9. Mount the User Class hive (UsrClass.dat) into HKU\<UserName>_Classes
  10. Set ACL on HKU\<UserName>_Classes and all subkeys for <Domain>\<UserName>
  11. Set ACL on HKU\<LocalUserSID>_Classes and all subkeys for <Domain>\<UserName> (just in case the user is actually logged in)
  12. Dismount HKU\<UserName>_Classes
  13. Read the ACL on the Profile Folder (set Earlier) for <Domain>\<UserName> to get the Domain User SID
  14. Convert the Domain User SID to an SDDL/String SID
  15. Pre-stage/Seed the Domain User Profile by creating a new Registry key in HKLM\Software\Microsoft\Windows NT\CurrentVersion\ProfileList\<DomainUserSDDL>
  16. Write in a few choice keys, the two most important being ProfileImagePath (String) and Sid (Binary). (The others I seeded were the DWords State and Flags, which were set to 0, and CentralProfile, which was an empty string).

Once the eDirectory user is no longer a member of a DLU enabled User Profile Package, they will be forced to log on through the Active Directory Domain (yes, we are still logging on through the Novell Client). The Profile used for the Domain User will be the same as that used by the Local user. The added benefit is that our rollback strategy becomes “Add user to a DLU enabled User Policy Package” and gets them to log back into their original profile. To safely secure a situation where there is a catastrophic failure of the profile (loss) a backup of the profile can also be done at the seeding stage (just check %userdomain% for equality with %computername% to see if they are logging on with a Local account or a Domain Account).

This has had only minor testing at this stage, but as no paths have changed and there appears to be no problem with the Domain User using the existing Profile I believe this is a reasonably comprehensive solution. This, I must stress, is not a recommended way to deal with migrating users, but it is a tricky little feature that can be abused as I have just demonstrated.

Code (or VBScript) will follow soon

Cheers, Chris.

]]> http://www.dwarfsoft.com/blog/2010/03/12/shared-user-profiles-alternative-to-migration/feed/ 3 More GTD-PHP Work http://www.dwarfsoft.com/blog/2009/08/20/more-gtd-php-work/ http://www.dwarfsoft.com/blog/2009/08/20/more-gtd-php-work/#comments Thu, 20 Aug 2009 05:53:44 +0000 dwarfsoft http://www.dwarfsoft.com/blog/?p=282 I have updated my GTD-PHP Email Import Addon so that it now integrates with the current Subversion revision of the code. There is one bug left in it, in that it will not check that there is a mail server set before it tries to connect. I find that this error occurs the first time the session is established with the server, and from then on it works fine. By performing an error check against $server = “” I should be able to remove that bug as well.

The updated EmailImport Addon is now available for download from the GTD-PHP Trac wiki.

I have since moved on to the next most important feature on my personal list of Enhancements (yes, before I fix my known bug in the previous one). I want to be able to have a scheduled email sent every morning with a report on what Actions are overdue, what actions are due today and a rundown on the coming actions in the next week. Additionally this report should contain information on Project deadlines of note (overdue, due and coming). Another report I want is to be able to have the weekly review report emailed weekly to myself (at my work and home email addresses).

To achieve this I have been looking in to using php scripts to create cron jobs on the host system (or schtasks jobs if on a WAMP server for example). I have most of the information required to achieve this now. Once I have implemented a scheduled tasks manager from within GTD-PHP I will then build a custom report builder, which will then be enhanced by the emailer. In all, three addons become interlocked for completing this next feature.

If I didn’t have GTD-PHP (and therefore wasn’t following the GTD methodology) to manage all my projects I probably would not be in the position of even being capable of extending any project (I am busier now than ever, but I have more control over my time than ever before). By completing the Addons in my list I will have so much better control over my time and be in a perfect position to achieve some Zen in my life :) .

Just so you get some perspective, when I first set up GTD-PHP I added a lot of actions, and immediately closed them. Those statistics had me max at about 30 items in a week. Currently this week I have closed 75 items, and the week isn’t over. Most of these items have been self imposed actions for me to develop, research, repair, investigate, or whatever. I have given myself more work than at the start, and I have more time off now to blog about it (yet another action) than I have ever had previously.

I thoroughly encourage everybody to look into David Allens Getting Things Done. Worked wonders for me :)

Cheers, Chris.

]]> http://www.dwarfsoft.com/blog/2009/08/20/more-gtd-php-work/feed/ 0 GTD-PHP Import from POP3 Mail http://www.dwarfsoft.com/blog/2009/08/04/gtd-php-import-from-pop3-mail/ http://www.dwarfsoft.com/blog/2009/08/04/gtd-php-import-from-pop3-mail/#comments Mon, 03 Aug 2009 21:00:28 +0000 dwarfsoft http://www.dwarfsoft.com/blog/2009/08/04/gtd-php-import-from-pop3-mail/ I have been attempting to get a fully working system set up for David Allens Getting Things Done. To this end I have set up an install of GTD-PHP.

Being the kind of person who likes to adapt, change, and implement better solutions, particularly for myself, I created a list of features I would like to see in my GTD-PHP installation. One of the first problems I had with the existing system was that it does not support importing Inbox items from a real mail Inbox.

I did some research and came across an existing mail importer, however this required directly piping mail from SMTP into the php script, which I could not do on my host (or would prefer not to do).

I decided to build my own POP3 Importer of Inbox items and decided to learn PHP and imap_open. I built it as an addon to GTD-PHP that could be called to do an import, however I am still going to extend it so that in the GTD-PHP header additional headers can be called (ones that identify if new items have been added to an Inbox so I can get feedback of when somebody mails into that account).

<?php
//Script to insert e-mails into GTD-PHP inbox.
//These are loaded from a pop3 account
//The account info and other options are configured in the config.php file
//$config['addons']['pop3inbox']=array(
//        "link"=>"addons/pop3inbox/import.php",
//        'title'=>"Import POP3 Mail", 'label'=>"Import Inbox",
//        'where'=>'item.php?type=i','when'=>'after',
//        'options'=>array("user"   => 'gtduser',
//                         "pass"   => 'gtdpass',
//                         "server" => 'mail.server.com',
//                         "port"   => '995',
//                         "type"   => '/pop3/ssl/novalidate-cert',
//                         "delete" => true)
//                         );
//Subject becomes title
//From & Body becomes description
$title='Import POP3 Inbox';
include_once 'header.php';
 
$msoptions = $addon['options'];
 
mysql_connect($config['host'],$config['user'],$config['pass']);
mysql_select_db($config['db']);
 
$imap = imap_open("{".$msoptions['server'].":".$msoptions['port'].$msoptions['type']."}INBOX", $msoptions['user'], $msoptions['pass']);
if (!$imap) {
   print_r(imap_errors());
} else {
  $num_msg = imap_num_msg($imap);
  include_once('gtdfuncs.php'); 
  echo "importing ".$num_msg." messages<br>";
  echo "<div class='success'>\n";
  for ($i = $num_msg; $i > 0; $i--)
  {
    // empty vars
    $from = "";
    $subject = "";
    $headers = "";
    $message = "";
 
    $header = imap_headerinfo($imap, $i, 80, 80);
 
    $from = $header->fromaddress;
    $subject = $header->fetchsubject;
    $date    = date('YmdHis', $header->udate);
 
    $message=imap_body($imap, $i);
    $message="From: ".$from."\n\n".$message;
 
    mysql_query("INSERT INTO `".$config['prefix']."items` ( `itemId` , `title` , `description` , `desiredOutcome` )VALUES (NULL , '$subject', '$message', NULL);");
  mysql_query("INSERT INTO `".$config['prefix']."itemstatus` (`itemId`, `dateCreated`, `lastModified`, `dateCompleted`) VALUES (NULL, '".date($config["datemask"])."', NOW(), NULL);");
    mysql_query("INSERT INTO `".$config['prefix']."itemattributes` ( `itemId` , `type` , `isSomeday` , `categoryId` , `contextId` , `timeframeId` , `deadline` , `repeat` , `suppress` , `suppressUntil` )VALUES (NULL , 'i', 'n', '0', '0', '0', NULL , '0', 'n', NULL);");
 
    echo "Imported '".stripslashes(escapeChars($subject)),"' into Inbox<br />\n";
    if ($msoptions['delete'])
      imap_delete($imap, $i);
  }
  echo "</div>";
  if ($msoptions['delete'])
    imap_expunge($imap);
  imap_close($imap);
}
include_once 'footer.php';
?>

Works pretty well at this point. Though I am having problems getting mail into that POP3 account. Will have to work further on that today :)

Cheers, Chris.

]]> http://www.dwarfsoft.com/blog/2009/08/04/gtd-php-import-from-pop3-mail/feed/ 0 GroupWise Audit and Batch/Cmd Escaping http://www.dwarfsoft.com/blog/2009/07/27/groupwise-audit-and-batchcmd-escaping/ http://www.dwarfsoft.com/blog/2009/07/27/groupwise-audit-and-batchcmd-escaping/#comments Mon, 27 Jul 2009 04:52:37 +0000 dwarfsoft http://www.dwarfsoft.com/blog/?p=259 I was required recently to audit passwords on all the Novell GroupWise accounts in the cluster. This was not too much of a problem using existing solutions, except that all the existing solutions limited searches to either Users, or to objects with the “NGW: Object ID” attribute.

The Solutions I found include Check GroupWise Users for Password – Batch and Check GroupWise Users for Password – Exe, both of which made use of GWSend. Being an avid scripting aficionado myself I opted for the first, so I could make changes.

First step was to export all User Objects with NGW: Object ID into an Excel sheet using DSReport. Then export all GroupWise External Entities with NGW: Object ID to a different Excel Sheet. Finally I needed to export all GroupWise Resources, which do not have an NGW: Object ID, but their CN is effectively the NGW: Object ID for which we can log in and try to send emails. Upon completing this I compiled a single list of Allusers.csv which had the NGW: ObjectID/CN in the first column, and the DN for the Object Name and Location within the tree. This makes it far easier to track down the location of generic accounts (Something that none of the scripts account for).

So, my first run through the script ended in Fail. Apparently the above solutions are expecting Email Addresses without Spaces. So after fixing that up I run it again, and again hit a Fail. Apparently the above solutions fail to account for special characters (/ in this instance). So, I fix this up as well… My script runs, I get a report, then I realise that I have more results than original users. Apparently the above script also assumes that there is only 1 line in the result.txt file. So I modified the script to only print out a result once all lines of the result.txt file had been parsed, using a SET to determine if the “Error:” had been encountered or not (Error indicating that a Password is on the account, no Error indicating that there is No password).

So, now I run through and notice that the audit fails to log the full line of text, even though it is capable of actually running the audit against that account. Fortunately none of the accounts without passwords were affected by this, but I decided to fix this for future runs. To break down the issues I needed to fix into a list here is the summary:

  1. We have spaces in our Email Account Names
  2. We have /’s in our Email Account Names
  3. We have &’s in our Email Account Names
  4. We are trying to create a HTML file with the above special characters (specifically &)
  5. & doesn’t tend to work too nicely in batch files when using an open Echo (tries to run everything after the & as a program
  6. I wanted to be able to track back to objects (DN’s) as opposed to just the GroupWise Account Name

Spaces were easy to fix… When running the command against an account simply put the “account in quotes”. The next step is to handle the Email and DN objects as Strings within Quotes as well, but we don’t want to output the quotes, which means we need to handle them properly. Examine the following issue:

SET String=A String With Special Chars&Slashes/ In \ it^ OK
ECHO %String%

This will return “‘Slashes’ is not recognized as an internal or external command, operable program or batch file.” Also, if we try and escape each of the characters we run into issues too.

SET String=A String With Special Chars&Slashes/ In \ it^ OK
SET String=%String:^=^^%
SET String=%String:\=^\%
SET String=%String:/=^/%
SET String=%String:&=^&%
ECHO %String%

The Output ends up as “A String With Special Chars”. So, in order to fix this we need to handle the string within Quotes, and only output it at the end:

SET String="A String With Special Chars&Slashes/ In \ it^ OK"
SET String=%String:^=^^%
SET String=%String:\=^\%
SET String=%String:/=^/%
SET String=%String:&=^&%
ECHO %String:~1,-1%

Finally, our output is “A String With Special Chars&Slashes/ In \ it^ OK”, without the quotes. So the first part works now for my output to the Logs (although my logs are CSV so I tend to leave the quotes on just in case there is a lurking comma, but this does provide a pretty Output to the Console). Now we need to convert these for HTML output.

SET String=%String:^&=^&amp;%
SET String=%String:<=^&lt;%
SET String=%String:>=^&gt;%
ECHO %String:~1,-1%

Just provides that little added extra safety net for an echo directly into a HTML log. I am annoyed that I didn’t manage to figure this out earlier as I had some scripts I went directly to VBScript for to avoid the & errors I was getting. I had no idea that it was my subsequent SET x=%x:a=b%, SET x=%x:c=d% calls on an unquoted string.

The one caveat I have found to this is fixing quote marks within a string. I have yet to find a way to strip them effectively without breaking the string/batch file in the process. The closest I have come will work in most situations, but requires a placeholder you have to be sure will never exist within your string:

SET String=Thi\s" is ^a &t"es/t
SET String="%String:"=&quot;%"
Set String=%String:^=^^%
SET String=%String:&=^&%
SET String=%String:/=^/%
SET String=%String:\=^\%
SET String=%String:&quot;=^"%
ECHO %String:~1,-1%

One other note I’d like to add is that of Padding numbers. This is a fairly well known feature of WinBatch, but I found it useful for getting well aligned output for which record I was currently up to:

Set _Num=0
...
SET /A %_Num%=%_Num%+1
SET DispNum=     %_Num%
Echo %DispNum:~-4%

This pads the leading digits with spaces and specifies that I want a 4 character long string returned for the end of the string. (so ” 1″ in the first instance but in my case up to ” 900″ or “9091″).

Hope this adds a little food for thought.

Cheers, Chris.

]]> http://www.dwarfsoft.com/blog/2009/07/27/groupwise-audit-and-batchcmd-escaping/feed/ 1